[ 570.569782] env[69491]: INFO neutron.common.config [-] Logging enabled! [ 570.570019] env[69491]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev45 [ 570.570307] env[69491]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69491) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 570.570648] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 570.570759] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 570.571611] env[69491]: WARNING oslo_policy.policy [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 570.571846] env[69491]: WARNING oslo_policy.policy [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 570.573390] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] VMware NSXv3 Agent initialized successfully. [ 570.573751] env[69491]: DEBUG oslo_concurrency.lockutils [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] Acquiring lock "singleton_lock" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.573891] env[69491]: DEBUG oslo_concurrency.lockutils [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] Acquired lock "singleton_lock" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.574128] env[69491]: DEBUG oslo_concurrency.lockutils [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] Releasing lock "singleton_lock" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.575521] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] Full set of CONF: {{(pid=69491) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 570.575662] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ******************************************************************************** {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 570.575788] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] Configuration options gathered from: {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 570.576064] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 570.576262] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 570.576404] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ================================================================================ {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 570.576599] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] agent_down_time = 75 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.576755] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] allow_automatic_dhcp_failover = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.576905] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] allow_bulk = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.577082] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] api_extensions_path = {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.577318] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] api_paste_config = api-paste.ini {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.577398] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] auth_strategy = keystone {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.577502] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] backdoor_port = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.577619] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] backdoor_socket = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.577839] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] backlog = 4096 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.577912] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.578090] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] bind_host = 0.0.0.0 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.578248] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] bind_port = 9696 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.578622] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] client_socket_timeout = 900 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.578871] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] config_dir = [] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.579051] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.579288] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] config_source = [] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.579410] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] control_exchange = neutron {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.579567] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] core_plugin = ml2 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.579782] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] debug = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.579992] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] default_availability_zones = [] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.580251] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.580526] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] dhcp_agent_notification = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.580633] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] dhcp_agents_per_network = 1 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.580798] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] dhcp_lease_duration = 86400 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.580958] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] dhcp_load_type = networks {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.581125] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] dns_domain = openstacklocal {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.581276] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.581453] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] enable_default_route_bfd = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.581603] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] enable_default_route_ecmp = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.581747] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] enable_dvr = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.581893] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] enable_new_agents = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.582045] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.582190] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] enable_signals = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.582346] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] enable_traditional_dhcp = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.582500] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] external_dns_driver = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.582645] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] filter_validation = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.582795] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] global_physnet_mtu = 8950 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.582940] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] graceful_shutdown_timeout = 60 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.583142] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] host = cpu-1 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.583295] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] host_dvr_for_dhcp = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.583442] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] http_retries = 3 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.583589] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] instance_format = [instance: %(uuid)s] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.583736] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.583882] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ipam_driver = internal {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.584034] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ipv6_pd_enabled = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.584180] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] l3_ha = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.584376] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.584531] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] l3_ha_network_physical_name = {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.584676] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] l3_ha_network_type = {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.584824] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] log_color = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.584970] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] log_config_append = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.585162] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.585359] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] log_dir = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.585512] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] log_file = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.585629] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] log_options = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.585775] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] log_rotate_interval = 1 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.585927] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] log_rotate_interval_type = days {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.586089] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] log_rotation_type = none {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.586208] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.586333] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.586496] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.586702] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.586836] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.587050] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] max_dns_nameservers = 5 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.587256] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] max_header_line = 16384 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.587474] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] max_l3_agents_per_router = 3 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.587712] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] max_logfile_count = 30 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.587881] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] max_logfile_size_mb = 200 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.588040] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] max_subnet_host_routes = 20 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.588200] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] my_ip = 10.180.1.21 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.588375] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] my_ipv6 = ::1 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.588528] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] network_auto_schedule = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.588668] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] network_link_prefix = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.588822] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.589021] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] notify_nova_on_port_data_changes = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.589205] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] notify_nova_on_port_status_changes = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.589401] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] pagination_max_limit = -1 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.589557] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] publish_errors = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.589703] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] rate_limit_burst = 0 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.589868] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] rate_limit_except_level = CRITICAL {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.590050] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] rate_limit_interval = 0 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.590203] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] retry_until_window = 30 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.590362] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] router_distributed = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.590518] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] rpc_resources_processing_step = 20 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.590679] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] rpc_response_max_timeout = 600 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.590916] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] rpc_response_timeout = 60 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.591105] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] send_events_interval = 2 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.591275] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] service_plugins = ['router'] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.591433] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] setproctitle = on {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.591573] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] shell_completion = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.591719] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] state_path = /opt/stack/data/neutron {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.591868] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] syslog_log_facility = LOG_USER {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.592019] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] tcp_keepidle = 600 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.592168] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] transport_url = **** {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.592312] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] use_journal = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.592453] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] use_json = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.592593] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] use_ssl = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.592733] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] use_stderr = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.592879] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] use_syslog = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.593052] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] vlan_qinq = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.593282] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] vlan_transparent = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.593452] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] watch_log_file = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.593600] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] wsgi_default_pool_size = 100 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.593742] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] wsgi_keep_alive = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.593893] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.594048] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] wsgi_server_debug = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 570.594215] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_concurrency.disable_process_locking = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.594393] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.594562] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.594708] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.594860] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.595015] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.595241] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.595450] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler.connection_string = messaging:// {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.595610] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler.enabled = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.595766] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler.es_doc_type = notification {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.595911] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler.es_scroll_size = 10000 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.596075] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler.es_scroll_time = 2m {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.596246] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler.filter_error_trace = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.596416] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler.hmac_keys = **** {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.596572] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler.sentinel_service_name = mymaster {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.596727] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler.socket_timeout = 0.1 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.596872] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler.trace_requests = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.597025] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler.trace_sqlalchemy = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.597187] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler_jaeger.process_tags = {} {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.597328] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler_jaeger.service_name_prefix = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.597532] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] profiler_otlp.service_name_prefix = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.597625] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_policy.enforce_new_defaults = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.597908] env[69491]: WARNING oslo_config.cfg [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 570.598083] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_policy.enforce_scope = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.598239] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_policy.policy_default_rule = default {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.598435] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.598598] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.598753] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.598895] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.599061] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.599305] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.599484] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.599641] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.599802] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.599962] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] agent.extensions = [] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.600128] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.600282] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] service_providers.service_provider = [] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.600438] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] QUOTAS.default_quota = -1 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.600592] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.600736] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] QUOTAS.quota_floatingip = 50 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.600877] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] QUOTAS.quota_network = 100 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.601027] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] QUOTAS.quota_port = 500 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.601172] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.601313] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] QUOTAS.quota_router = 10 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.601459] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] QUOTAS.quota_security_group = 10 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.601602] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.601743] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] QUOTAS.quota_subnet = 100 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.601882] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] QUOTAS.track_quota_usage = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.602050] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.602195] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep.group = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.602350] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep.helper_command = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.602521] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.602694] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep.thread_pool_size = 8 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.602840] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep.user = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.602995] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.603174] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_dhcp_release.group = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.603328] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_dhcp_release.helper_command = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.603480] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.603653] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.603816] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_dhcp_release.user = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.603971] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.604125] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_ovs_vsctl.group = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.604268] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.604419] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.604566] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.604706] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_ovs_vsctl.user = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.604852] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_namespace.capabilities = [21] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.604995] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_namespace.group = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.605229] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_namespace.helper_command = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.605480] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.605742] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.605986] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_namespace.user = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.606187] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_conntrack.capabilities = [12] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.606346] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_conntrack.group = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.606507] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_conntrack.helper_command = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.606694] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.606848] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.606990] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_conntrack.user = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.607186] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_link.capabilities = [12, 21] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.607336] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_link.group = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.607478] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_link.helper_command = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.607653] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.607807] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_link.thread_pool_size = 8 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.607973] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] privsep_link.user = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.608156] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.608351] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.608490] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.continue_on_failed_promotions = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.608632] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.dscp = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.608775] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.dscp_inherit = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.608925] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.force_mp_to_policy = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.609082] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.locking_coordinator_url = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.609256] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.log_agent_heartbeats = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.609441] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.logging_expire = 1 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.609594] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.609741] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.609893] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.polling_interval = 240 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.610051] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.610206] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.610378] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.report_interval = 30.0 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.610541] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.610694] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.610843] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.610990] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.sync_skew = 60 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.611150] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.synchronization_queue_size = 20 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.611336] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT.use_helper_for_ns_read = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.611504] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] SECURITYGROUP.enable_ipset = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.611659] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] SECURITYGROUP.enable_security_group = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.611808] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.611957] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.612122] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] experimental.ipv6_pd_enabled = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.612287] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ml2.extension_drivers = ['port_security'] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.612438] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ml2.external_network_type = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.612596] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.612788] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ml2.overlay_ip_version = 4 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.612953] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ml2.path_mtu = 8950 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.613116] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ml2.physical_network_mtus = {} {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.613300] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.613462] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.613647] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ml2.type_drivers = ['vlan'] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.613822] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.613989] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.614180] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.614360] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.614550] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.614712] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.614884] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.615064] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.615261] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.615512] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.615691] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_login_password = **** {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.615882] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.616174] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_login_user = admin {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.616437] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.616665] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.616832] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.616987] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.617162] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.617320] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.617553] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.617620] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.617801] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.617981] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.618134] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.618328] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.618458] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.618677] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.618837] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.618989] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.619151] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.619337] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] nova.auth_section = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.619518] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] nova.auth_type = password {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.619673] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.619816] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] nova.certfile = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.619962] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] nova.collect_timing = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.620129] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] nova.endpoint_type = public {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.620276] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] nova.insecure = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.620413] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] nova.keyfile = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.620563] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] nova.region_name = RegionOne {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.620708] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] nova.split_loggers = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.620849] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] nova.timeout = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.620998] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] placement.auth_section = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.621165] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] placement.auth_type = password {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.621314] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.621456] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] placement.certfile = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.621599] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] placement.collect_timing = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.621747] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] placement.endpoint_type = public {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.621891] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] placement.insecure = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.622040] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] placement.keyfile = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.622181] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] placement.region_name = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.622323] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] placement.split_loggers = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.622463] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] placement.timeout = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.622610] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.auth_section = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.622754] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.auth_type = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.622894] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.cafile = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.623041] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.certfile = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.623189] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.collect_timing = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.623328] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.connect_retries = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.623468] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.connect_retry_delay = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.623609] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.enable_notifications = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.623748] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.endpoint_override = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.623890] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.insecure = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.624037] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.interface = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.624177] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.keyfile = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.624314] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.max_version = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.624451] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.min_version = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.624585] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.region_name = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.624721] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.retriable_status_codes = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.625054] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.service_name = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.625054] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.service_type = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.625172] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.split_loggers = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.625270] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.status_code_retries = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.625410] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.status_code_retry_delay = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.625551] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.timeout = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.625687] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.valid_interfaces = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.625828] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ironic.version = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.625975] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] cli_script.dry_run = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.626143] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.626287] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.626434] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.626574] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.626714] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.626853] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.626990] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.627144] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.627285] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.627435] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.627575] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.627721] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.627912] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.628034] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.628160] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.628328] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.628485] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.628630] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.628780] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.628923] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.629076] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.629223] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.629409] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.629577] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.629726] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.629872] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.630027] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.630174] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.630318] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.630463] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.630608] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.ssl = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.630758] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.630900] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.631359] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.631359] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.631359] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.631489] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.631627] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_notifications.driver = [] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.631770] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_notifications.retry = -1 {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.631957] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.632074] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 570.632190] env[69491]: DEBUG oslo_service.backend.eventlet.service [None req-799643a8-c885-4c27-9ab9-3437cc400071 None None] ******************************************************************************** {{(pid=69491) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 570.633208] env[69491]: DEBUG neutron.agent.securitygroups_rpc [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Init firewall settings (driver=nsxv3) {{(pid=69491) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 570.634568] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69491) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 570.634829] env[69491]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] RPC agent_id: nsxm-l-01a.corp.local [ 570.637229] env[69491]: DEBUG dogpile.cache.region [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 570.637354] env[69491]: DEBUG dogpile.lock [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 570.637461] env[69491]: DEBUG dogpile.lock [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 570.637550] env[69491]: DEBUG dogpile.lock [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 570.637646] env[69491]: DEBUG dogpile.cache.region [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 570.637738] env[69491]: DEBUG dogpile.lock [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 570.637878] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 570.661261] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Session token - acquiring [ 570.662857] env[69491]: DEBUG networking_nsxv3.common.locking [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.663098] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.663164] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.663605] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.674027] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.961878] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 570.983867] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 570.984087] env[69491]: DEBUG dogpile.cache.region [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Cache value generated in 0.346 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 570.984193] env[69491]: DEBUG dogpile.lock [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 570.984262] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Activating Policy API Provider. [ 570.984465] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Looking for the default Infrastructure Rules. [ 571.051325] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Looking for the Default Layer3 Logged Drop Section. [ 571.069289] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 571.069770] env[69491]: DEBUG networking_nsxv3.common.locking [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.069955] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquiring lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.070075] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.070362] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired external semaphore "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.070695] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.585822] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.087739] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.590053] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Inventory metadata is going to be refreshed. [ 572.590416] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 573.461679] env[69491]: DEBUG networking_nsxv3.common.locking [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.462045] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.462045] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.462354] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.473295] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 573.474197] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.475101] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 573.493938] env[69491]: DEBUG networking_nsxv3.common.locking [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.494251] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.494251] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.494556] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.494843] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.494953] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 573.495017] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 573.495131] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 573.513700] env[69491]: DEBUG networking_nsxv3.common.locking [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.514018] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.514018] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.514315] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.514500] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.514731] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 573.534211] env[69491]: DEBUG networking_nsxv3.common.locking [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.534499] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.534578] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.535373] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.535530] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.535684] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 573.556136] env[69491]: DEBUG networking_nsxv3.common.locking [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.556456] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquiring lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.556456] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.557090] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired external semaphore "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.557090] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Releasing lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.557090] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 573.557287] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 573.557287] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 573.576297] env[69491]: DEBUG networking_nsxv3.common.locking [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.576588] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquiring lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.576588] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.576904] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired external semaphore "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.577049] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Releasing lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.577208] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 573.577321] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 573.577434] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 573.596879] env[69491]: DEBUG networking_nsxv3.common.locking [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.597360] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.597360] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.597589] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.597745] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.597915] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 573.598028] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 573.598192] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Inventory metadata have been refreshed. [ 573.598300] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Dryrun:True. Metadata refresh completed. [ 573.598440] env[69491]: DEBUG oslo_concurrency.lockutils [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Releasing lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.600282] env[69491]: INFO neutron.agent.agent_extensions_manager [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Loaded agent extensions: [] [ 573.601029] env[69491]: DEBUG neutron_lib.callbacks.manager [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69491) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 573.665905] env[69491]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] NSXv3 Agent Agent RPC Daemon Started! [ 573.666079] env[69491]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] NSXv3 Agent Agent loop - iteration:0 started [ 573.666222] env[69491]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] NSXv3 Agent Agent out of sync with plugin! [ 578.602051] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 578.602051] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 583.602753] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 583.602753] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 588.424471] env[69491]: INFO networking_nsxv3.common.synchronization [None req-f5978d2e-30b6-4c53-a25b-6dc1055097fa demo admin] Enqueued Resource ID: 4aeeba01-f0e2-488b-9fde-f9bbbb8eddfa with Priority: HIGHEST for action security_group_rules [ 588.425017] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aeeba01-f0e2-488b-9fde-f9bbbb8eddfa with Priority: HIGHEST for action security_group_rules [ 588.425336] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4aeeba01-f0e2-488b-9fde-f9bbbb8eddfa taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.425466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4aeeba01-f0e2-488b-9fde-f9bbbb8eddfa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.425542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4aeeba01-f0e2-488b-9fde-f9bbbb8eddfa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.425906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4aeeba01-f0e2-488b-9fde-f9bbbb8eddfa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.425994] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4aeeba01-f0e2-488b-9fde-f9bbbb8eddfa',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.946593] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.946915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.946915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.947096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.947141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.947250] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4aeeba01-f0e2-488b-9fde-f9bbbb8eddfa already deleted. [ 588.947332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4aeeba01-f0e2-488b-9fde-f9bbbb8eddfa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.426071] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 593.426071] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 598.426835] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 598.427205] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 599.604504] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.604903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.604903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.604985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.605199] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.107858] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.611072] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.112776] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 601.112996] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 601.852523] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.852974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.852974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.852974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.865048] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 601.865831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.866438] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 601.885665] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.885854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.885854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.886080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.886167] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.886280] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 601.886351] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 601.886482] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 601.908701] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.908933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.908933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.909140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.909275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.909384] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 601.929888] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.930112] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.930112] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.930313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.930417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.930526] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 601.951466] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.951707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.951707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.951906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.951989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.952126] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 601.952198] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 601.952269] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 601.974956] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.975230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.975230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.975407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.975487] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.975607] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 601.975682] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 601.975757] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 601.995247] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.995502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.995502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.995647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.995739] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.995863] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 601.995935] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 601.996011] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 601.996082] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 601.996155] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 601.996216] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 601.996279] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 601.996555] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 601.996619] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 601.996687] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 602.019232] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.019475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.019475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.019651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.019786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.019892] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 602.038297] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.038541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.038541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.038716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.038820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.052238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.428294] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 603.428705] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 608.429699] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 608.430115] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 613.430394] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 613.430651] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 616.317394] env[69491]: INFO networking_nsxv3.common.synchronization [None req-60b3fc00-7176-495f-9c75-bebe74dd3ac1 None None] Enqueued Resource ID: ef2be220-52b9-43f5-95f4-b52784029f48 with Priority: HIGHEST for action port [ 616.318017] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2be220-52b9-43f5-95f4-b52784029f48 with Priority: HIGHEST for action port [ 616.318336] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef2be220-52b9-43f5-95f4-b52784029f48 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.318486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef2be220-52b9-43f5-95f4-b52784029f48" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.318550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef2be220-52b9-43f5-95f4-b52784029f48" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.318802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef2be220-52b9-43f5-95f4-b52784029f48" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.318884] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef2be220-52b9-43f5-95f4-b52784029f48',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.824022] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef2be220-52b9-43f5-95f4-b52784029f48 [ 616.824022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.824022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.824022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.824022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.824022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.824022] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef2be220-52b9-43f5-95f4-b52784029f48 already deleted. [ 616.824022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef2be220-52b9-43f5-95f4-b52784029f48" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.199213] env[69491]: INFO networking_nsxv3.common.synchronization [None req-dbefa481-06f3-4ee2-9769-db88f93aa2d6 None None] Enqueued Resource ID: 7eefe91c-cf06-416b-b09e-d20256797ab7 with Priority: HIGHEST for action port [ 618.199776] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eefe91c-cf06-416b-b09e-d20256797ab7 with Priority: HIGHEST for action port [ 618.200667] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-7eefe91c-cf06-416b-b09e-d20256797ab7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.201149] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7eefe91c-cf06-416b-b09e-d20256797ab7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.201401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7eefe91c-cf06-416b-b09e-d20256797ab7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.201705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7eefe91c-cf06-416b-b09e-d20256797ab7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.201874] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eefe91c-cf06-416b-b09e-d20256797ab7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.704394] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7eefe91c-cf06-416b-b09e-d20256797ab7 [ 618.704883] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.704883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.704883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.705146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.705239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.705342] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7eefe91c-cf06-416b-b09e-d20256797ab7 already deleted. [ 618.705424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7eefe91c-cf06-416b-b09e-d20256797ab7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.579422] env[69491]: INFO networking_nsxv3.common.synchronization [None req-4be93c7d-c2f2-4b85-8690-4930cc8598ac None None] Enqueued Resource ID: 858d7ee4-11c2-449d-9521-d98fb2322a04 with Priority: HIGHEST for action port [ 619.579761] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858d7ee4-11c2-449d-9521-d98fb2322a04 with Priority: HIGHEST for action port [ 619.580305] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-858d7ee4-11c2-449d-9521-d98fb2322a04 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.580386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-858d7ee4-11c2-449d-9521-d98fb2322a04" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.580577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-858d7ee4-11c2-449d-9521-d98fb2322a04" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.580700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-858d7ee4-11c2-449d-9521-d98fb2322a04" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.580790] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('858d7ee4-11c2-449d-9521-d98fb2322a04',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.084893] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 858d7ee4-11c2-449d-9521-d98fb2322a04 [ 620.085321] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.085466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.085567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.086283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.086283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.086283] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:858d7ee4-11c2-449d-9521-d98fb2322a04 already deleted. [ 620.086283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-858d7ee4-11c2-449d-9521-d98fb2322a04" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.926910] env[69491]: INFO networking_nsxv3.common.synchronization [None req-f0e57100-dc0a-4e45-98be-d069b1d767d5 None None] Enqueued Resource ID: 1f919e3b-f7e7-4776-bfec-63e66efd9f09 with Priority: HIGHEST for action port [ 620.927830] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f919e3b-f7e7-4776-bfec-63e66efd9f09 with Priority: HIGHEST for action port [ 620.927876] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f919e3b-f7e7-4776-bfec-63e66efd9f09 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.928599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f919e3b-f7e7-4776-bfec-63e66efd9f09" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.928599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f919e3b-f7e7-4776-bfec-63e66efd9f09" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.928599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f919e3b-f7e7-4776-bfec-63e66efd9f09" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.928599] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f919e3b-f7e7-4776-bfec-63e66efd9f09',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.412191] env[69491]: INFO networking_nsxv3.common.synchronization [None req-8a0e872e-d1f8-41ff-9e33-6f296e398599 None None] Enqueued Resource ID: 9413f54a-b64e-42f9-8688-968907320895 with Priority: HIGHEST for action port [ 621.412191] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9413f54a-b64e-42f9-8688-968907320895 with Priority: HIGHEST for action port [ 621.412191] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-9413f54a-b64e-42f9-8688-968907320895 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.412191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9413f54a-b64e-42f9-8688-968907320895" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.412191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9413f54a-b64e-42f9-8688-968907320895" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.412191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9413f54a-b64e-42f9-8688-968907320895" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.417151] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9413f54a-b64e-42f9-8688-968907320895',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.432136] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f919e3b-f7e7-4776-bfec-63e66efd9f09 [ 621.432136] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.432136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.432136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.432136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.432136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.432136] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f919e3b-f7e7-4776-bfec-63e66efd9f09 already deleted. [ 621.432136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f919e3b-f7e7-4776-bfec-63e66efd9f09" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.924637] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9413f54a-b64e-42f9-8688-968907320895 [ 621.924637] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.924637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.924637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.924637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.924637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.924637] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9413f54a-b64e-42f9-8688-968907320895 already deleted. [ 621.924637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9413f54a-b64e-42f9-8688-968907320895" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.946238] env[69491]: INFO networking_nsxv3.common.synchronization [None req-428dd024-7efd-4606-8c27-d1abe378162e None None] Enqueued Resource ID: 9c78fe58-7caa-4916-9734-6553c0a4cd30 with Priority: HIGHEST for action port [ 621.946505] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c78fe58-7caa-4916-9734-6553c0a4cd30 with Priority: HIGHEST for action port [ 621.947095] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c78fe58-7caa-4916-9734-6553c0a4cd30 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.947300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c78fe58-7caa-4916-9734-6553c0a4cd30" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.947341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c78fe58-7caa-4916-9734-6553c0a4cd30" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.947556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c78fe58-7caa-4916-9734-6553c0a4cd30" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.947639] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c78fe58-7caa-4916-9734-6553c0a4cd30',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.182334] env[69491]: INFO networking_nsxv3.common.synchronization [None req-3e504e4f-7a54-4033-a402-65c6401bf7d1 None None] Enqueued Resource ID: 217f6918-92ca-4164-b6dd-612ce1ad8309 with Priority: HIGHEST for action port [ 622.182385] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 217f6918-92ca-4164-b6dd-612ce1ad8309 with Priority: HIGHEST for action port [ 622.184255] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-217f6918-92ca-4164-b6dd-612ce1ad8309 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.184255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-217f6918-92ca-4164-b6dd-612ce1ad8309" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.184255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-217f6918-92ca-4164-b6dd-612ce1ad8309" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.184255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-217f6918-92ca-4164-b6dd-612ce1ad8309" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.184255] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('217f6918-92ca-4164-b6dd-612ce1ad8309',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.450945] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c78fe58-7caa-4916-9734-6553c0a4cd30 [ 622.451589] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.451811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.451892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.452190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.452242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.452966] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c78fe58-7caa-4916-9734-6553c0a4cd30 already deleted. [ 622.452966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c78fe58-7caa-4916-9734-6553c0a4cd30" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.687134] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 217f6918-92ca-4164-b6dd-612ce1ad8309 [ 622.688281] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.688281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.688281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.688443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.688443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.688555] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:217f6918-92ca-4164-b6dd-612ce1ad8309 already deleted. [ 622.688639] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-217f6918-92ca-4164-b6dd-612ce1ad8309" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.416370] env[69491]: INFO networking_nsxv3.common.synchronization [None req-b5e98e78-d8a4-48f1-b8ca-d74615f0ec09 None None] Enqueued Resource ID: 7f69ffdb-185a-4941-9505-00dfa5ddd90a with Priority: HIGHEST for action port [ 624.416820] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f69ffdb-185a-4941-9505-00dfa5ddd90a with Priority: HIGHEST for action port [ 624.417315] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f69ffdb-185a-4941-9505-00dfa5ddd90a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.418428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f69ffdb-185a-4941-9505-00dfa5ddd90a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.418428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f69ffdb-185a-4941-9505-00dfa5ddd90a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.418579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f69ffdb-185a-4941-9505-00dfa5ddd90a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.418617] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f69ffdb-185a-4941-9505-00dfa5ddd90a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.596282] env[69491]: INFO networking_nsxv3.common.synchronization [None req-2c4e5165-910f-494e-98e2-74e00651ca81 None None] Enqueued Resource ID: 735489a0-03d9-4dba-b42e-4ea396f49450 with Priority: HIGHEST for action port [ 624.596282] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735489a0-03d9-4dba-b42e-4ea396f49450 with Priority: HIGHEST for action port [ 624.596282] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-735489a0-03d9-4dba-b42e-4ea396f49450 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.596688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-735489a0-03d9-4dba-b42e-4ea396f49450" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.596688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-735489a0-03d9-4dba-b42e-4ea396f49450" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.596947] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-735489a0-03d9-4dba-b42e-4ea396f49450" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.597073] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('735489a0-03d9-4dba-b42e-4ea396f49450',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.920195] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f69ffdb-185a-4941-9505-00dfa5ddd90a [ 624.923442] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.923442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.923442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.923442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.923442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.923442] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f69ffdb-185a-4941-9505-00dfa5ddd90a already deleted. [ 624.923442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f69ffdb-185a-4941-9505-00dfa5ddd90a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.101222] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 735489a0-03d9-4dba-b42e-4ea396f49450 [ 625.101457] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.101619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.101701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.101915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.101998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.102587] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:735489a0-03d9-4dba-b42e-4ea396f49450 already deleted. [ 625.102587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-735489a0-03d9-4dba-b42e-4ea396f49450" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.193092] env[69491]: INFO networking_nsxv3.common.synchronization [None req-e3a7de6b-8b14-44fb-add6-dfa6461df152 None None] Enqueued Resource ID: c625cf97-4b50-4ddd-b94c-93cfde3d99ca with Priority: HIGHEST for action port [ 625.193493] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c625cf97-4b50-4ddd-b94c-93cfde3d99ca with Priority: HIGHEST for action port [ 625.193996] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-c625cf97-4b50-4ddd-b94c-93cfde3d99ca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.193996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c625cf97-4b50-4ddd-b94c-93cfde3d99ca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.193996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c625cf97-4b50-4ddd-b94c-93cfde3d99ca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.194352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c625cf97-4b50-4ddd-b94c-93cfde3d99ca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.194352] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c625cf97-4b50-4ddd-b94c-93cfde3d99ca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.478933] env[69491]: INFO networking_nsxv3.common.synchronization [None req-09662947-ca0e-4f80-b363-277af12d9255 None None] Enqueued Resource ID: 40aff9b8-ef97-4da5-968a-29c660c50be9 with Priority: HIGHEST for action port [ 625.479210] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40aff9b8-ef97-4da5-968a-29c660c50be9 with Priority: HIGHEST for action port [ 625.479936] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-40aff9b8-ef97-4da5-968a-29c660c50be9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.479936] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40aff9b8-ef97-4da5-968a-29c660c50be9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.480239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40aff9b8-ef97-4da5-968a-29c660c50be9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.480239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40aff9b8-ef97-4da5-968a-29c660c50be9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.480714] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40aff9b8-ef97-4da5-968a-29c660c50be9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.515609] env[69491]: INFO networking_nsxv3.common.synchronization [None req-49b77657-96e1-48c6-8240-63485341a6c4 None None] Enqueued Resource ID: 63012ba7-1df6-490b-bd40-8ded7d5eaddd with Priority: HIGHEST for action port [ 625.515609] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63012ba7-1df6-490b-bd40-8ded7d5eaddd with Priority: HIGHEST for action port [ 625.515609] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-63012ba7-1df6-490b-bd40-8ded7d5eaddd taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.515609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63012ba7-1df6-490b-bd40-8ded7d5eaddd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.515609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63012ba7-1df6-490b-bd40-8ded7d5eaddd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.515609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63012ba7-1df6-490b-bd40-8ded7d5eaddd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.515609] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63012ba7-1df6-490b-bd40-8ded7d5eaddd',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.698655] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c625cf97-4b50-4ddd-b94c-93cfde3d99ca [ 625.698655] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.698655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.698817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.699115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.699275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.699383] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c625cf97-4b50-4ddd-b94c-93cfde3d99ca already deleted. [ 625.699526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c625cf97-4b50-4ddd-b94c-93cfde3d99ca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.987036] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40aff9b8-ef97-4da5-968a-29c660c50be9 [ 625.987036] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.987036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.987036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.987036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.987337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.987337] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40aff9b8-ef97-4da5-968a-29c660c50be9 already deleted. [ 625.987412] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40aff9b8-ef97-4da5-968a-29c660c50be9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.017746] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63012ba7-1df6-490b-bd40-8ded7d5eaddd [ 626.019289] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.019566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.019566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.020166] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.020166] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.020579] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63012ba7-1df6-490b-bd40-8ded7d5eaddd already deleted. [ 626.020720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63012ba7-1df6-490b-bd40-8ded7d5eaddd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.517028] env[69491]: INFO networking_nsxv3.common.synchronization [None req-ec27149f-a785-4018-8409-fee396933c15 None None] Enqueued Resource ID: af80b41a-c55e-463c-af32-dfab8ea55664 with Priority: HIGHEST for action port [ 626.517962] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af80b41a-c55e-463c-af32-dfab8ea55664 with Priority: HIGHEST for action port [ 626.518437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-af80b41a-c55e-463c-af32-dfab8ea55664 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.518569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af80b41a-c55e-463c-af32-dfab8ea55664" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.518641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af80b41a-c55e-463c-af32-dfab8ea55664" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.519060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af80b41a-c55e-463c-af32-dfab8ea55664" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.519060] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af80b41a-c55e-463c-af32-dfab8ea55664',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.696488] env[69491]: INFO networking_nsxv3.common.synchronization [None req-455ee1a5-abfa-4796-b3be-9d7b8b47b8ab None None] Enqueued Resource ID: 8c8f9fed-1e46-4b55-9f39-f36991a7f344 with Priority: HIGHEST for action port [ 626.696488] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8f9fed-1e46-4b55-9f39-f36991a7f344 with Priority: HIGHEST for action port [ 626.696488] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c8f9fed-1e46-4b55-9f39-f36991a7f344 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.696488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c8f9fed-1e46-4b55-9f39-f36991a7f344" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.696488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c8f9fed-1e46-4b55-9f39-f36991a7f344" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.696488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c8f9fed-1e46-4b55-9f39-f36991a7f344" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.696488] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c8f9fed-1e46-4b55-9f39-f36991a7f344',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.022518] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af80b41a-c55e-463c-af32-dfab8ea55664 [ 627.022518] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.022895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.022895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.022958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.023104] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.023152] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af80b41a-c55e-463c-af32-dfab8ea55664 already deleted. [ 627.023287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af80b41a-c55e-463c-af32-dfab8ea55664" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.024892] env[69491]: INFO networking_nsxv3.common.synchronization [None req-5415587e-74c0-4219-a194-32305c826826 None None] Enqueued Resource ID: ee89130a-16b2-4db6-be0b-54071b0b16ac with Priority: HIGHEST for action port [ 627.025354] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee89130a-16b2-4db6-be0b-54071b0b16ac with Priority: HIGHEST for action port [ 627.025975] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee89130a-16b2-4db6-be0b-54071b0b16ac taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.026287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee89130a-16b2-4db6-be0b-54071b0b16ac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.026358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee89130a-16b2-4db6-be0b-54071b0b16ac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.026596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee89130a-16b2-4db6-be0b-54071b0b16ac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.026676] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee89130a-16b2-4db6-be0b-54071b0b16ac',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.199604] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c8f9fed-1e46-4b55-9f39-f36991a7f344 [ 627.200672] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.200855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.200924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.201449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.201648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.201833] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c8f9fed-1e46-4b55-9f39-f36991a7f344 already deleted. [ 627.201934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c8f9fed-1e46-4b55-9f39-f36991a7f344" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.528745] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee89130a-16b2-4db6-be0b-54071b0b16ac [ 627.530567] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.530761] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.530856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.531026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.531121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.531234] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee89130a-16b2-4db6-be0b-54071b0b16ac already deleted. [ 627.531307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee89130a-16b2-4db6-be0b-54071b0b16ac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.240838] env[69491]: INFO networking_nsxv3.common.synchronization [None req-d32bb4f0-da12-401c-a7aa-73bdf98a28f7 tempest-ServerActionsTestOtherB-761111206 tempest-ServerActionsTestOtherB-761111206-project-member] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_rules [ 628.242469] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_rules [ 628.243281] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.243281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.243281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.243281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.244188] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.347516] env[69491]: INFO networking_nsxv3.common.synchronization [None req-efd690a8-d882-4f71-85db-419df3d3f8fb tempest-ServerActionsTestOtherB-761111206 tempest-ServerActionsTestOtherB-761111206-project-member] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_rules [ 628.350499] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_rules [ 628.350499] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.350499] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.587897] env[69491]: INFO networking_nsxv3.common.synchronization [None req-0028aa05-14cf-4579-a126-a3d317c0f134 None None] Enqueued Resource ID: 4e34f994-0a24-4c57-8123-adabae363ad9 with Priority: HIGHEST for action port [ 628.588315] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e34f994-0a24-4c57-8123-adabae363ad9 with Priority: HIGHEST for action port [ 628.588315] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e34f994-0a24-4c57-8123-adabae363ad9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.588660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e34f994-0a24-4c57-8123-adabae363ad9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.588660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e34f994-0a24-4c57-8123-adabae363ad9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.588774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e34f994-0a24-4c57-8123-adabae363ad9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.588806] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e34f994-0a24-4c57-8123-adabae363ad9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.752966] env[69491]: INFO networking_nsxv3.common.synchronization [req-77fad8e0-541c-46c3-a52f-c6d6dd5c51c5 req-b294cd61-b704-4b2b-ae9d-b329e290973b tempest-ServerDiagnosticsTest-1805878952 tempest-ServerDiagnosticsTest-1805878952-project-member] Enqueued Resource ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f with Priority: HIGHEST for action security_group_members [ 628.752966] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f with Priority: HIGHEST for action security_group_members [ 628.753111] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.753165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.753208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.753714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.753714] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.753804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.753851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.754019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.754378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.754872] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.766568] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.766699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.766838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.767190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.767262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.767305] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 already deleted. [ 628.767403] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.767561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.767718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.767801] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.978126] env[69491]: INFO networking_nsxv3.common.synchronization [None req-b9e2f5b7-de0e-4bc8-9a4a-8f73e64d41f9 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: f1812f0f-128b-41f6-987e-18e589d1ef41 with Priority: HIGHEST for action security_group_rules [ 628.978551] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1812f0f-128b-41f6-987e-18e589d1ef41 with Priority: HIGHEST for action security_group_rules [ 628.978865] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1812f0f-128b-41f6-987e-18e589d1ef41 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.979238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.979238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.979335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.979391] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1812f0f-128b-41f6-987e-18e589d1ef41',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.005493] env[69491]: INFO networking_nsxv3.common.synchronization [None req-3c34012e-b033-4d44-9ff3-e2fc99089ea2 None None] Enqueued Resource ID: bb7fc617-e806-415a-a716-aa5eb1cfc88b with Priority: HIGHEST for action port [ 629.005493] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb7fc617-e806-415a-a716-aa5eb1cfc88b with Priority: HIGHEST for action port [ 629.005493] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb7fc617-e806-415a-a716-aa5eb1cfc88b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.005493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb7fc617-e806-415a-a716-aa5eb1cfc88b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.005493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb7fc617-e806-415a-a716-aa5eb1cfc88b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.006408] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb7fc617-e806-415a-a716-aa5eb1cfc88b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.006408] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb7fc617-e806-415a-a716-aa5eb1cfc88b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.054832] env[69491]: INFO networking_nsxv3.common.synchronization [None req-9f07de98-7622-4184-bb2d-aeee8142bcec tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: f1812f0f-128b-41f6-987e-18e589d1ef41 with Priority: HIGHEST for action security_group_rules [ 629.054832] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1812f0f-128b-41f6-987e-18e589d1ef41 with Priority: HIGHEST for action security_group_rules [ 629.055113] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1812f0f-128b-41f6-987e-18e589d1ef41 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.055113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.092314] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e34f994-0a24-4c57-8123-adabae363ad9 [ 629.092463] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.092630] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.092695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.092935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.093079] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.093189] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e34f994-0a24-4c57-8123-adabae363ad9 already deleted. [ 629.093363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e34f994-0a24-4c57-8123-adabae363ad9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.256860] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.257281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.257474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.257947] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.258999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.258999] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.258999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.258999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.258999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.258999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.259318] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f already deleted. [ 629.259318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.289875] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.289875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.289875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.289875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.289875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.289875] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 already deleted. [ 629.289875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.509400] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.509400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.509400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.509400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.509400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.509400] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1812f0f-128b-41f6-987e-18e589d1ef41 already deleted. [ 629.509400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.509400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.509400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.509400] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1812f0f-128b-41f6-987e-18e589d1ef41',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.512503] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb7fc617-e806-415a-a716-aa5eb1cfc88b [ 629.512706] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.512830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.512895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.513088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.513182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.513274] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb7fc617-e806-415a-a716-aa5eb1cfc88b already deleted. [ 629.513507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb7fc617-e806-415a-a716-aa5eb1cfc88b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.524082] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.524288] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.526970] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.526970] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.526970] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.526970] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.526970] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.526970] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.526970] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.526970] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.526970] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.526970] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.526970] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.526970] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.527627] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.527627] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.549838] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.549838] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 629.549838] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.549838] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.549971] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-748c7ad9-8ad1-4091-ba3e-53a615fc70b3 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.550045] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-748c7ad9-8ad1-4091-ba3e-53a615fc70b3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.550583] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-748c7ad9-8ad1-4091-ba3e-53a615fc70b3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.551203] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-748c7ad9-8ad1-4091-ba3e-53a615fc70b3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.551932] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('748c7ad9-8ad1-4091-ba3e-53a615fc70b3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.032241] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.032498] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.032498] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.032700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.032807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.032870] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1812f0f-128b-41f6-987e-18e589d1ef41 already deleted. [ 630.032954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.041234] env[69491]: INFO networking_nsxv3.common.synchronization [req-5c246c82-69c5-409a-a122-d4275548ee96 req-4bd9a009-88c1-4060-ad8a-8717f81f0b86 tempest-DeleteServersAdminTestJSON-986727250 tempest-DeleteServersAdminTestJSON-986727250-project-member] Enqueued Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_members [ 630.041965] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_members [ 630.042288] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.042412] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.042480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.042721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.042873] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.042975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.043237] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.043464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.043584] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.043707] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.054368] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.054625] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.054766] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.055067] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.055370] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.055443] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 748c7ad9-8ad1-4091-ba3e-53a615fc70b3 not found, creating... [ 630.055654] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.055815] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.055937] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.056179] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.056407] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.057058] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.057058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.057058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.057449] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.057655] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.057844] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 748c7ad9-8ad1-4091-ba3e-53a615fc70b3 is going to be created. [ 630.082694] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.082694] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.082694] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.082694] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.082694] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.082694] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-748c7ad9-8ad1-4091-ba3e-53a615fc70b3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.480025] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.480025] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.480025] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.480025] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.480025] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.480025] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.480025] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.480025] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.480739] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.481138] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 630.481752] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.481752] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.481752] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.482128] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 630.484377] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.484377] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.504174] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.504174] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 630.504174] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.504174] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.504174] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-c0cfe81b-f30e-491d-8c80-5e1fc97562e2 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.504174] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-c0cfe81b-f30e-491d-8c80-5e1fc97562e2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.504174] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-c0cfe81b-f30e-491d-8c80-5e1fc97562e2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.504174] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-c0cfe81b-f30e-491d-8c80-5e1fc97562e2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.504174] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0cfe81b-f30e-491d-8c80-5e1fc97562e2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.547207] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.547207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.547207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.547492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.547492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.547662] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.547759] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.547817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.547963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.548044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.548147] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 already deleted. [ 630.548247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.007401] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.007724] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.007763] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.008031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.008191] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.008372] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port c0cfe81b-f30e-491d-8c80-5e1fc97562e2 not found, creating... [ 631.008644] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.008828] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.009035] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.009283] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.010224] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.010224] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.010224] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.010224] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.012605] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.012605] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.012605] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: c0cfe81b-f30e-491d-8c80-5e1fc97562e2 is going to be created. [ 631.034416] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.034416] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.034416] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.034416] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.034816] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.034816] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-c0cfe81b-f30e-491d-8c80-5e1fc97562e2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.186820] env[69491]: INFO networking_nsxv3.common.synchronization [req-77fad8e0-541c-46c3-a52f-c6d6dd5c51c5 req-7546d526-ce49-41d7-bc43-2846ff4f4ac7 service nova] Enqueued Resource ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f with Priority: HIGHEST for action security_group_rules [ 631.187132] env[69491]: INFO networking_nsxv3.common.synchronization [req-77fad8e0-541c-46c3-a52f-c6d6dd5c51c5 req-7546d526-ce49-41d7-bc43-2846ff4f4ac7 service nova] Enqueued Resource ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f with Priority: HIGHEST for action security_group_members [ 631.187238] env[69491]: INFO networking_nsxv3.common.synchronization [req-77fad8e0-541c-46c3-a52f-c6d6dd5c51c5 req-7546d526-ce49-41d7-bc43-2846ff4f4ac7 service nova] Enqueued Resource ID: 748c7ad9-8ad1-4091-ba3e-53a615fc70b3 with Priority: HIGHEST for action port [ 631.187778] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f with Priority: HIGHEST for action security_group_rules [ 631.187975] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f with Priority: HIGHEST for action security_group_members [ 631.192272] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 748c7ad9-8ad1-4091-ba3e-53a615fc70b3 with Priority: HIGHEST for action port [ 631.196248] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.196248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.196248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.196248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.196248] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.196248] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.196248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.196248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.196248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.196248] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.196248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.196248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.196248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.196248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.196248] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.199204] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-748c7ad9-8ad1-4091-ba3e-53a615fc70b3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.199204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-748c7ad9-8ad1-4091-ba3e-53a615fc70b3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.199204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-748c7ad9-8ad1-4091-ba3e-53a615fc70b3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.199204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-748c7ad9-8ad1-4091-ba3e-53a615fc70b3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.199204] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('748c7ad9-8ad1-4091-ba3e-53a615fc70b3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.700394] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.700589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.713106] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 748c7ad9-8ad1-4091-ba3e-53a615fc70b3 with status ACTIVE [ 631.713106] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.713106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.713106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.713353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.713525] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.713636] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.713748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.713819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.713981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.714082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.714272] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.714366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.714428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.714693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.714693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.714778] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 748c7ad9-8ad1-4091-ba3e-53a615fc70b3 is going to be updated. [ 631.717251] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.739022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.739370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.739485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.739695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.740327] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.740566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-748c7ad9-8ad1-4091-ba3e-53a615fc70b3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.183478] env[69491]: INFO networking_nsxv3.common.synchronization [req-5c246c82-69c5-409a-a122-d4275548ee96 req-098d9043-dc72-483a-931c-31dd316beebb service nova] Enqueued Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_rules [ 632.184242] env[69491]: INFO networking_nsxv3.common.synchronization [req-5c246c82-69c5-409a-a122-d4275548ee96 req-098d9043-dc72-483a-931c-31dd316beebb service nova] Enqueued Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_members [ 632.185665] env[69491]: INFO networking_nsxv3.common.synchronization [req-5c246c82-69c5-409a-a122-d4275548ee96 req-098d9043-dc72-483a-931c-31dd316beebb service nova] Enqueued Resource ID: c0cfe81b-f30e-491d-8c80-5e1fc97562e2 with Priority: HIGHEST for action port [ 632.185753] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_rules [ 632.185911] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_members [ 632.186183] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0cfe81b-f30e-491d-8c80-5e1fc97562e2 with Priority: HIGHEST for action port [ 632.186445] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.186587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.186735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.187051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.187163] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.188464] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.188632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.188632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.188810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.188977] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.189137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.189209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.189372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.189456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.189580] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.190438] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0cfe81b-f30e-491d-8c80-5e1fc97562e2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.190545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0cfe81b-f30e-491d-8c80-5e1fc97562e2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.190590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0cfe81b-f30e-491d-8c80-5e1fc97562e2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.190792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0cfe81b-f30e-491d-8c80-5e1fc97562e2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.190883] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0cfe81b-f30e-491d-8c80-5e1fc97562e2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.219985] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.648160] env[69491]: INFO networking_nsxv3.common.synchronization [req-5d7b5da4-fb16-438c-a1d1-cc25e9cf353e req-992ff426-5674-421b-9036-e3cf6af1a528 tempest-ServerExternalEventsTest-1587261735 tempest-ServerExternalEventsTest-1587261735-project-member] Enqueued Resource ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf with Priority: HIGHEST for action security_group_members [ 632.648731] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf with Priority: HIGHEST for action security_group_members [ 632.649140] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9023993-36fc-47c8-9c97-1eea2e87c7cf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.650507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.650622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.651530] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.651819] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.654718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.655034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.655247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.655345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.655689] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9023993-36fc-47c8-9c97-1eea2e87c7cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.692236] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.692772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.692772] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.693420] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0cfe81b-f30e-491d-8c80-5e1fc97562e2 with status ACTIVE [ 632.693612] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.693728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.693868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.694175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.694290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.694486] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.694591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.694656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.694826] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.694905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.695613] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.695767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.695858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.696065] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.696178] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.696295] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0cfe81b-f30e-491d-8c80-5e1fc97562e2 is going to be updated. [ 632.719568] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.720048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.720150] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.720366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.720525] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.720700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0cfe81b-f30e-491d-8c80-5e1fc97562e2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.722570] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.722708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.722778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.722954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.723049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.723141] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f is going to be created. [ 632.748324] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.749179] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.749304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.749541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.749703] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.760652] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f in Status: UNINITIALIZED for 2s [ 633.158449] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.158627] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.158703] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.158915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.159011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.159210] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.159302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.161859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.161859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.161859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.161859] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf already deleted. [ 633.161859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.198690] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.474913] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.475139] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.475291] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.475610] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.476517] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.476700] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.476827] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.477187] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.477315] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.477538] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.477653] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.477783] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.477966] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.478118] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.478284] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.478398] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.497645] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.497885] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 633.497988] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.498220] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.498560] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-2f45908e-d746-4a6e-a049-7024cec71b24 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.498746] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-2f45908e-d746-4a6e-a049-7024cec71b24" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.498882] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-2f45908e-d746-4a6e-a049-7024cec71b24" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.499471] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-2f45908e-d746-4a6e-a049-7024cec71b24" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.499471] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f45908e-d746-4a6e-a049-7024cec71b24',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.704985] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.704985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.704985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.704985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.704985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.704985] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 is going to be created. [ 633.731123] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.731409] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.731409] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.731709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.731980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.745355] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: UNINITIALIZED for 2s [ 634.003562] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.003807] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.003936] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.004300] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.004461] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.004621] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 2f45908e-d746-4a6e-a049-7024cec71b24 not found, creating... [ 634.004903] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.005088] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.005239] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.005477] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.005613] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.007473] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.007698] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.007826] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.008076] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.008296] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.008458] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 2f45908e-d746-4a6e-a049-7024cec71b24 is going to be created. [ 634.030342] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.030716] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.030716] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.031645] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.031645] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.031645] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-2f45908e-d746-4a6e-a049-7024cec71b24" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.314256] env[69491]: INFO networking_nsxv3.common.synchronization [None req-0463d0f8-dd08-4e20-bf58-1b69ca59b177 None None] Enqueued Resource ID: c51c34ef-4958-4fa7-9210-1ac46ec4c472 with Priority: HIGHEST for action port [ 634.314256] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c51c34ef-4958-4fa7-9210-1ac46ec4c472 with Priority: HIGHEST for action port [ 634.314256] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-c51c34ef-4958-4fa7-9210-1ac46ec4c472 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.315276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c51c34ef-4958-4fa7-9210-1ac46ec4c472" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.315488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c51c34ef-4958-4fa7-9210-1ac46ec4c472" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.315859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c51c34ef-4958-4fa7-9210-1ac46ec4c472" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.316119] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c51c34ef-4958-4fa7-9210-1ac46ec4c472',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.576541] env[69491]: INFO networking_nsxv3.common.synchronization [req-61edfee9-9095-494e-8eb7-a12547c537cd req-c80795de-bf6f-493e-8c9d-daddaeccb003 tempest-ServerDiskConfigTestJSON-964931906 tempest-ServerDiskConfigTestJSON-964931906-project-member] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 634.577064] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 634.577175] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.577404] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.577404] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.577627] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.578462] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.578608] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.578668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.578931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.579055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.579157] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.770181] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f in Status: SUCCESS [ 634.771386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.772196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.772399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.772599] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.772756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.772792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.772937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.773027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.773144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.773201] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.818193] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c51c34ef-4958-4fa7-9210-1ac46ec4c472 [ 634.818566] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.818789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.818925] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.819405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.819405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.819405] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c51c34ef-4958-4fa7-9210-1ac46ec4c472 already deleted. [ 634.819641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c51c34ef-4958-4fa7-9210-1ac46ec4c472" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.943598] env[69491]: INFO networking_nsxv3.common.synchronization [None req-7fe78d5d-039b-4eef-9843-a592d567b70c None None] Enqueued Resource ID: 74c13aa8-965d-49f8-824f-e78fb60f8116 with Priority: HIGHEST for action port [ 634.944213] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c13aa8-965d-49f8-824f-e78fb60f8116 with Priority: HIGHEST for action port [ 634.944821] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-74c13aa8-965d-49f8-824f-e78fb60f8116 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.944940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74c13aa8-965d-49f8-824f-e78fb60f8116" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.945020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74c13aa8-965d-49f8-824f-e78fb60f8116" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.945740] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74c13aa8-965d-49f8-824f-e78fb60f8116" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.946187] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74c13aa8-965d-49f8-824f-e78fb60f8116',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.081620] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.081768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.081836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.082182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.082271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.082466] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.082567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.082693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.082863] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.082937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.083033] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff already deleted. [ 635.083110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.279093] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.279288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.279332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.279586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.279920] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.279920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.280057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.280324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.280507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.280667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.280872] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.281010] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.282139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.282354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.282546] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.282691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.282775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.283083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.283168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.283250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.283338] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.305271] env[69491]: INFO networking_nsxv3.common.synchronization [req-5d7b5da4-fb16-438c-a1d1-cc25e9cf353e req-530d7b87-3068-4d9d-bcd0-dacd4c72c779 service nova] Enqueued Resource ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf with Priority: HIGHEST for action security_group_rules [ 635.305437] env[69491]: INFO networking_nsxv3.common.synchronization [req-5d7b5da4-fb16-438c-a1d1-cc25e9cf353e req-530d7b87-3068-4d9d-bcd0-dacd4c72c779 service nova] Enqueued Resource ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf with Priority: HIGHEST for action security_group_members [ 635.305570] env[69491]: INFO networking_nsxv3.common.synchronization [req-5d7b5da4-fb16-438c-a1d1-cc25e9cf353e req-530d7b87-3068-4d9d-bcd0-dacd4c72c779 service nova] Enqueued Resource ID: 2f45908e-d746-4a6e-a049-7024cec71b24 with Priority: HIGHEST for action port [ 635.305798] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf with Priority: HIGHEST for action security_group_rules [ 635.308243] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf with Priority: HIGHEST for action security_group_members [ 635.308243] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f45908e-d746-4a6e-a049-7024cec71b24 with Priority: HIGHEST for action port [ 635.308243] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9023993-36fc-47c8-9c97-1eea2e87c7cf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.308243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.308243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.308243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.308243] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9023993-36fc-47c8-9c97-1eea2e87c7cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.309181] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9023993-36fc-47c8-9c97-1eea2e87c7cf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.309181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.309290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.309428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.309580] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.309675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.309736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.309890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.309969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.310079] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9023993-36fc-47c8-9c97-1eea2e87c7cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.312049] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f45908e-d746-4a6e-a049-7024cec71b24 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.312049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f45908e-d746-4a6e-a049-7024cec71b24" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.312049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f45908e-d746-4a6e-a049-7024cec71b24" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.312049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f45908e-d746-4a6e-a049-7024cec71b24" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.312049] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f45908e-d746-4a6e-a049-7024cec71b24',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.425065] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-956 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.425065] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.425065] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.425065] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.425845] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.425845] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.425845] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.425845] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.425845] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.428759] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 635.428759] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.428759] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.428759] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.428759] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 635.428996] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.428996] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.448930] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.449110] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 635.449250] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.449432] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.449751] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-d3717758-e628-433e-828a-3a322b822bd0 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.449923] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-d3717758-e628-433e-828a-3a322b822bd0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.450056] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-d3717758-e628-433e-828a-3a322b822bd0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.450414] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-d3717758-e628-433e-828a-3a322b822bd0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.450551] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3717758-e628-433e-828a-3a322b822bd0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.451836] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74c13aa8-965d-49f8-824f-e78fb60f8116 [ 635.452025] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.452139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.452204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.452381] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.452460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.452547] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74c13aa8-965d-49f8-824f-e78fb60f8116 already deleted. [ 635.452623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74c13aa8-965d-49f8-824f-e78fb60f8116" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.594307] env[69491]: INFO networking_nsxv3.common.synchronization [None req-b1ea76d2-056e-4b31-96c3-372a8bbd8d48 None None] Enqueued Resource ID: 78342cb9-2110-4d2b-a925-c8642022c7d8 with Priority: HIGHEST for action port [ 635.594968] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78342cb9-2110-4d2b-a925-c8642022c7d8 with Priority: HIGHEST for action port [ 635.595375] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-78342cb9-2110-4d2b-a925-c8642022c7d8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.595509] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78342cb9-2110-4d2b-a925-c8642022c7d8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.595579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78342cb9-2110-4d2b-a925-c8642022c7d8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.595825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78342cb9-2110-4d2b-a925-c8642022c7d8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.595904] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78342cb9-2110-4d2b-a925-c8642022c7d8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.758160] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: SUCCESS [ 635.759071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.759071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.759071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.759071] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.759071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.759071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.759346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.759346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.759411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.759477] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.786478] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f: rpc.has_security_group_logging(os_id): False [ 635.799418] env[69491]: INFO networking_nsxv3.common.synchronization [None req-94580616-023e-4b95-bfe4-4da7613b24ab None None] Enqueued Resource ID: f8a9deb7-3969-4f38-904f-eca10593d6a6 with Priority: HIGHEST for action port [ 635.799913] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8a9deb7-3969-4f38-904f-eca10593d6a6 with Priority: HIGHEST for action port [ 635.801475] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8a9deb7-3969-4f38-904f-eca10593d6a6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.802540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8a9deb7-3969-4f38-904f-eca10593d6a6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.802540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8a9deb7-3969-4f38-904f-eca10593d6a6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.803679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8a9deb7-3969-4f38-904f-eca10593d6a6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.803679] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8a9deb7-3969-4f38-904f-eca10593d6a6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.812053] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.812053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.812053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.812053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.812053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.812053] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.812053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.812053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.812567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.812567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.812567] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.812567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.816259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.816259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.816259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.816259] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.816259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.816259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.816259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.816259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.816259] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f is going to be created. [ 635.816259] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9023993-36fc-47c8-9c97-1eea2e87c7cf taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.816259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.816259] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9023993-36fc-47c8-9c97-1eea2e87c7cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.816879] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f45908e-d746-4a6e-a049-7024cec71b24 with status ACTIVE [ 635.816963] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.817801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.817878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.818100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.818160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.818355] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.818481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.818603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.818699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.818775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.818965] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.819169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.819169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.819617] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.819617] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.819617] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f45908e-d746-4a6e-a049-7024cec71b24 is going to be updated. [ 635.846270] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.847455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.847455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.847455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.847455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.847455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f45908e-d746-4a6e-a049-7024cec71b24" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.880850] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.880850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.881095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.881336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.881480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.897164] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f in Status: IN_PROGRESS for 2s [ 635.955597] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.955851] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.955920] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.956415] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.956597] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.956786] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port d3717758-e628-433e-828a-3a322b822bd0 not found, creating... [ 635.958161] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.958161] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.958161] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.958161] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.958161] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.958544] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.958764] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.958918] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.959246] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.959407] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.959604] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: d3717758-e628-433e-828a-3a322b822bd0 is going to be created. [ 636.029906] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.029906] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.029906] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.029906] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.029906] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.029906] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-d3717758-e628-433e-828a-3a322b822bd0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.100657] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78342cb9-2110-4d2b-a925-c8642022c7d8 [ 636.102140] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.102140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.102140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.102140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.102140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.102140] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78342cb9-2110-4d2b-a925-c8642022c7d8 already deleted. [ 636.102140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78342cb9-2110-4d2b-a925-c8642022c7d8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.262519] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.262791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.262826] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.263049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.263230] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.263336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.263401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.264075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.264075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.264075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.264075] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.264075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.264075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.264335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.264335] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.264399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.264436] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.267605] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.267605] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.267605] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.267605] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.307876] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8a9deb7-3969-4f38-904f-eca10593d6a6 [ 636.308193] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.308304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.308364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.308706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.308706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.308804] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8a9deb7-3969-4f38-904f-eca10593d6a6 already deleted. [ 636.308848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8a9deb7-3969-4f38-904f-eca10593d6a6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.317966] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9023993-36fc-47c8-9c97-1eea2e87c7cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.532557] env[69491]: INFO networking_nsxv3.common.synchronization [None req-d22e04cf-2013-4acb-9aa4-6db0b72faca8 None None] Enqueued Resource ID: 4182d591-a520-420e-bd3b-8c232b1751c9 with Priority: HIGHEST for action port [ 636.532557] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4182d591-a520-420e-bd3b-8c232b1751c9 with Priority: HIGHEST for action port [ 636.532974] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-4182d591-a520-420e-bd3b-8c232b1751c9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.534096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4182d591-a520-420e-bd3b-8c232b1751c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.534096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4182d591-a520-420e-bd3b-8c232b1751c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.534096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4182d591-a520-420e-bd3b-8c232b1751c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.534096] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4182d591-a520-420e-bd3b-8c232b1751c9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.605622] env[69491]: INFO networking_nsxv3.common.synchronization [None req-3f9eeed6-530d-4541-9aca-3f43f9cb3a3d None None] Enqueued Resource ID: db79ef1f-7c2d-4a27-be40-90ce3055646e with Priority: HIGHEST for action port [ 636.609532] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db79ef1f-7c2d-4a27-be40-90ce3055646e with Priority: HIGHEST for action port [ 636.611011] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-db79ef1f-7c2d-4a27-be40-90ce3055646e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.611011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db79ef1f-7c2d-4a27-be40-90ce3055646e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.611011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db79ef1f-7c2d-4a27-be40-90ce3055646e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.611011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db79ef1f-7c2d-4a27-be40-90ce3055646e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.611011] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db79ef1f-7c2d-4a27-be40-90ce3055646e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.771821] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5d9b441-54c3-4ef0-8866-aee0f17f0fb9: rpc.has_security_group_logging(os_id): False [ 636.795122] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.795122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.795122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.795122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.795122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.795122] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.795122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.795122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.795122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.795122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.795122] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.795122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.795585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.795585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.795711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.795946] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.796113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.796593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.796593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.796593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.796593] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 is going to be created. [ 636.824020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.824020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.824020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.824020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.824020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.824020] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf is going to be created. [ 636.846085] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.846243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.846309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.846526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.846695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.858995] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf in Status: UNINITIALIZED for 2s [ 636.864574] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.866953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.866953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.866953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.866953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.877883] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: IN_PROGRESS for 2s [ 636.952219] env[69491]: INFO networking_nsxv3.common.synchronization [req-61edfee9-9095-494e-8eb7-a12547c537cd req-18964d7a-69cd-4f82-aa9b-faf9c680ccb5 service nova] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_rules [ 636.952219] env[69491]: INFO networking_nsxv3.common.synchronization [req-61edfee9-9095-494e-8eb7-a12547c537cd req-18964d7a-69cd-4f82-aa9b-faf9c680ccb5 service nova] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 636.952219] env[69491]: INFO networking_nsxv3.common.synchronization [req-61edfee9-9095-494e-8eb7-a12547c537cd req-18964d7a-69cd-4f82-aa9b-faf9c680ccb5 service nova] Enqueued Resource ID: d3717758-e628-433e-828a-3a322b822bd0 with Priority: HIGHEST for action port [ 636.953314] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_rules [ 636.953314] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 636.953314] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3717758-e628-433e-828a-3a322b822bd0 with Priority: HIGHEST for action port [ 636.953701] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.953963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.954214] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.954618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.955504] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.957684] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.957865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.957959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.959488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.959889] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.960047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.960217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.960566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.961643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.961643] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.962291] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3717758-e628-433e-828a-3a322b822bd0 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.962689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3717758-e628-433e-828a-3a322b822bd0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.962933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3717758-e628-433e-828a-3a322b822bd0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.963105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3717758-e628-433e-828a-3a322b822bd0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.963265] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3717758-e628-433e-828a-3a322b822bd0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.036979] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4182d591-a520-420e-bd3b-8c232b1751c9 [ 637.036979] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.036979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.036979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.036979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.036979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.036979] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4182d591-a520-420e-bd3b-8c232b1751c9 already deleted. [ 637.036979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4182d591-a520-420e-bd3b-8c232b1751c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.112995] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db79ef1f-7c2d-4a27-be40-90ce3055646e [ 637.115234] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.115234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.115234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.115234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.115234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.115234] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db79ef1f-7c2d-4a27-be40-90ce3055646e already deleted. [ 637.115234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db79ef1f-7c2d-4a27-be40-90ce3055646e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.467927] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.469056] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.469179] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.469491] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3717758-e628-433e-828a-3a322b822bd0 with status ACTIVE [ 637.469491] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.469601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.470464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.470464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.470464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.470464] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.470464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.470464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.470705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.470705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.471319] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.471319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.471319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.471319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.471319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.471588] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3717758-e628-433e-828a-3a322b822bd0 is going to be updated. [ 637.504506] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.504506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.504506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.504506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.504506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.504506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3717758-e628-433e-828a-3a322b822bd0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.856053] env[69491]: INFO networking_nsxv3.common.synchronization [req-1eb5c796-0da0-4398-b8dc-e90b61d59092 req-3d8ccc5f-4bb7-4c44-824f-4f6349c358f9 tempest-FloatingIPsAssociationNegativeTestJSON-434017054 tempest-FloatingIPsAssociationNegativeTestJSON-434017054-project-member] Enqueued Resource ID: 24376446-4b3c-421b-a079-0ca7bece8e3b with Priority: HIGHEST for action security_group_members [ 637.856053] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24376446-4b3c-421b-a079-0ca7bece8e3b with Priority: HIGHEST for action security_group_members [ 637.856857] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-24376446-4b3c-421b-a079-0ca7bece8e3b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.857019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.857137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.857399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.857574] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.857937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.857937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.857937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.858391] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.858391] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24376446-4b3c-421b-a079-0ca7bece8e3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.910078] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f in Status: SUCCESS [ 637.910343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.939875] env[69491]: INFO networking_nsxv3.common.synchronization [None req-7b4f22ea-07f8-46b9-b67e-a623756006f9 None None] Enqueued Resource ID: 63942dc7-7b61-42f7-9f6a-b02ea0648d4e with Priority: HIGHEST for action port [ 637.939875] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63942dc7-7b61-42f7-9f6a-b02ea0648d4e with Priority: HIGHEST for action port [ 637.941025] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-63942dc7-7b61-42f7-9f6a-b02ea0648d4e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.941025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63942dc7-7b61-42f7-9f6a-b02ea0648d4e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.941025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63942dc7-7b61-42f7-9f6a-b02ea0648d4e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.941025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63942dc7-7b61-42f7-9f6a-b02ea0648d4e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.941025] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63942dc7-7b61-42f7-9f6a-b02ea0648d4e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.973524] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.362048] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.362048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.362048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.362303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.362343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.362650] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.363037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.363122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.363299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.363376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.363471] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24376446-4b3c-421b-a079-0ca7bece8e3b already deleted. [ 638.363560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.445658] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63942dc7-7b61-42f7-9f6a-b02ea0648d4e [ 638.445897] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.446057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.446927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.446927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.446927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.446927] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63942dc7-7b61-42f7-9f6a-b02ea0648d4e already deleted. [ 638.446927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63942dc7-7b61-42f7-9f6a-b02ea0648d4e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.479742] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.480683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.480683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.480683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.480683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.480683] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be created. [ 638.506129] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.507131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.507461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.508725] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.508725] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.521620] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: UNINITIALIZED for 2s [ 638.870692] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf in Status: SUCCESS [ 638.870925] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.874200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.874200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.874200] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.874200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.874200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.874200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.874200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.874200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.874200] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9023993-36fc-47c8-9c97-1eea2e87c7cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.895301] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: SUCCESS [ 638.895301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.913400] env[69491]: INFO networking_nsxv3.common.synchronization [req-3bd43af5-10ef-4ec6-8a7a-606197b55fa5 req-e0a3eaa4-3542-4402-ac41-a8bf9f09e32c tempest-ImagesOneServerTestJSON-1348870833 tempest-ImagesOneServerTestJSON-1348870833-project-member] Enqueued Resource ID: 745f6209-d9d3-480b-9445-604b9585bfe0 with Priority: HIGHEST for action security_group_members [ 638.913976] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745f6209-d9d3-480b-9445-604b9585bfe0 with Priority: HIGHEST for action security_group_members [ 638.914367] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-745f6209-d9d3-480b-9445-604b9585bfe0 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.914518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.914603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.914859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.915362] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.915512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.915614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.915779] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.915866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.915966] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745f6209-d9d3-480b-9445-604b9585bfe0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.136534] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-696 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.137341] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-696" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.137341] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-696" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.137588] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-696" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.137768] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.138294] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.138294] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.138607] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.138948] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.139130] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.139393] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.139393] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.139881] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.140121] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.140205] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.140703] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.173969] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.174422] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 639.174554] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.174802] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-696" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.175328] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-2c7dbcfd-a9a9-495e-82eb-f51c91989ffc taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.175633] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-2c7dbcfd-a9a9-495e-82eb-f51c91989ffc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.175857] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-2c7dbcfd-a9a9-495e-82eb-f51c91989ffc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.176669] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-2c7dbcfd-a9a9-495e-82eb-f51c91989ffc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.176843] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c7dbcfd-a9a9-495e-82eb-f51c91989ffc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.375128] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9023993-36fc-47c8-9c97-1eea2e87c7cf taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.375366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.375433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.375646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.375816] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.375926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.375981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.376125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.376238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.376310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.376437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9023993-36fc-47c8-9c97-1eea2e87c7cf taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.376524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.376585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.376719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.376855] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.376991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.376991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.377206] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.377329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.377386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.377514] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9023993-36fc-47c8-9c97-1eea2e87c7cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.419573] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.419869] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.419869] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.420349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.420349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.420670] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.420785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.420848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.421208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.421426] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.421508] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745f6209-d9d3-480b-9445-604b9585bfe0 already deleted. [ 639.421549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.445255] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.445255] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-334" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.445255] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-334" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.445487] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-334" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.445950] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.446318] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.446608] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.447103] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.447378] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.447701] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.447935] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.448152] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.448353] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.449094] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.449926] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.451118] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.471734] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.471867] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 639.472017] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.472208] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-334" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.472529] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-7af0c7c0-c53b-4470-8ec3-3a442684f497 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.472707] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-7af0c7c0-c53b-4470-8ec3-3a442684f497" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.472830] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-7af0c7c0-c53b-4470-8ec3-3a442684f497" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.473176] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-7af0c7c0-c53b-4470-8ec3-3a442684f497" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.473320] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7af0c7c0-c53b-4470-8ec3-3a442684f497',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.680432] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.683307] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.683307] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.683307] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.683307] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.683307] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 2c7dbcfd-a9a9-495e-82eb-f51c91989ffc not found, creating... [ 639.683307] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.683307] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.683307] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.683307] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.683307] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.684162] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.684356] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.684552] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.684796] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.685041] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.685909] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 2c7dbcfd-a9a9-495e-82eb-f51c91989ffc is going to be created. [ 639.709591] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.709793] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.710272] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.710272] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.710575] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.710681] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-2c7dbcfd-a9a9-495e-82eb-f51c91989ffc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.883787] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9023993-36fc-47c8-9c97-1eea2e87c7cf: rpc.has_security_group_logging(os_id): False [ 639.888727] env[69491]: INFO networking_nsxv3.common.synchronization [None req-9e3f0335-fff8-4d02-9511-4d5818b0370a None None] Enqueued Resource ID: 88007eac-b012-49b7-b659-fb2cf4251bb4 with Priority: HIGHEST for action port [ 639.889628] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88007eac-b012-49b7-b659-fb2cf4251bb4 with Priority: HIGHEST for action port [ 639.890683] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-88007eac-b012-49b7-b659-fb2cf4251bb4 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.890832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88007eac-b012-49b7-b659-fb2cf4251bb4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.891215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88007eac-b012-49b7-b659-fb2cf4251bb4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.891215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88007eac-b012-49b7-b659-fb2cf4251bb4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.891477] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88007eac-b012-49b7-b659-fb2cf4251bb4',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.908207] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.908372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.908438] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.908651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.911633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.911633] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.911633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.911633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.911633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.911633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.911633] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.911633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.911633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.911633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.911633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.911633] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.911633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.911633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.912690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.912690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.912690] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf is going to be created. [ 639.977901] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.977901] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.977901] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.978165] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.978197] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.978519] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 7af0c7c0-c53b-4470-8ec3-3a442684f497 not found, creating... [ 639.978847] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.979102] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.979285] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.979607] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.979809] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.982237] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.982429] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.982555] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.982840] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.982986] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.983177] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 7af0c7c0-c53b-4470-8ec3-3a442684f497 is going to be created. [ 639.987846] env[69491]: INFO networking_nsxv3.common.synchronization [None req-c68af95a-119b-4263-984e-81bccd327619 tempest-VolumesAssistedSnapshotsTest-139761842 tempest-VolumesAssistedSnapshotsTest-139761842-project-member] Enqueued Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGHEST for action security_group_rules [ 639.988851] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGHEST for action security_group_rules [ 639.989631] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00540613-7092-4498-a250-9bb6d721591a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.989631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.989631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.989631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.989804] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00540613-7092-4498-a250-9bb6d721591a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.001344] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.001344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.001344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.001506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.001651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.009338] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.009628] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.009791] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.010183] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.010446] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.010682] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-7af0c7c0-c53b-4470-8ec3-3a442684f497" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.016362] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf in Status: IN_PROGRESS for 2s [ 640.367128] env[69491]: INFO networking_nsxv3.common.synchronization [None req-4cf4e4e1-2b5f-4a56-875a-79a0de5b08a4 tempest-VolumesAssistedSnapshotsTest-139761842 tempest-VolumesAssistedSnapshotsTest-139761842-project-member] Enqueued Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGHEST for action security_group_rules [ 640.367128] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGHEST for action security_group_rules [ 640.367128] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00540613-7092-4498-a250-9bb6d721591a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.367128] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.396160] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88007eac-b012-49b7-b659-fb2cf4251bb4 [ 640.396160] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.396160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.396160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.397651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.397651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.397651] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88007eac-b012-49b7-b659-fb2cf4251bb4 already deleted. [ 640.397651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88007eac-b012-49b7-b659-fb2cf4251bb4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.511749] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.512037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.512037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.512263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.512362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.512466] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00540613-7092-4498-a250-9bb6d721591a already deleted. [ 640.512542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.512700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.512895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.512991] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00540613-7092-4498-a250-9bb6d721591a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.534378] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 640.534700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.535844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.535844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.535844] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.535844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.535844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.535844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.535844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.535844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.536332] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.921705] env[69491]: INFO networking_nsxv3.common.synchronization [None req-898fa11d-7538-4886-9273-b42a419623c3 None None] Enqueued Resource ID: f0b2dbdd-7629-4b5d-bfab-9bd1dfa4f667 with Priority: HIGHEST for action port [ 640.922518] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b2dbdd-7629-4b5d-bfab-9bd1dfa4f667 with Priority: HIGHEST for action port [ 640.922895] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0b2dbdd-7629-4b5d-bfab-9bd1dfa4f667 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.923148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0b2dbdd-7629-4b5d-bfab-9bd1dfa4f667" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.923252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0b2dbdd-7629-4b5d-bfab-9bd1dfa4f667" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.925020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0b2dbdd-7629-4b5d-bfab-9bd1dfa4f667" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.925020] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0b2dbdd-7629-4b5d-bfab-9bd1dfa4f667',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.037324] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.037539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.037539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.037812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.038337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.038687] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00540613-7092-4498-a250-9bb6d721591a already deleted. [ 641.038718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.040095] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.040229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.040293] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.040573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.040742] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.040847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.040905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.041107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.041341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.041341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.041456] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.041706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.041706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.041706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.042106] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.042227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.042372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.042502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.042502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.042585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.042833] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.321811] env[69491]: INFO networking_nsxv3.common.synchronization [None req-bb2d524a-c919-48d6-a957-4dc32186c339 None None] Enqueued Resource ID: 1b9407cd-9840-4007-94e0-c8c2e0130658 with Priority: HIGHEST for action port [ 641.323284] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b9407cd-9840-4007-94e0-c8c2e0130658 with Priority: HIGHEST for action port [ 641.324426] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b9407cd-9840-4007-94e0-c8c2e0130658 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.324594] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b9407cd-9840-4007-94e0-c8c2e0130658" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.324788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b9407cd-9840-4007-94e0-c8c2e0130658" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.325117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b9407cd-9840-4007-94e0-c8c2e0130658" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.325447] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b9407cd-9840-4007-94e0-c8c2e0130658',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.428432] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0b2dbdd-7629-4b5d-bfab-9bd1dfa4f667 [ 641.430668] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.430668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.430668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.430668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.430668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.430668] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0b2dbdd-7629-4b5d-bfab-9bd1dfa4f667 already deleted. [ 641.430668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0b2dbdd-7629-4b5d-bfab-9bd1dfa4f667" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.546066] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab7773f0-7815-4a45-bf15-8a8079aa86ff: rpc.has_security_group_logging(os_id): False [ 641.567072] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.567355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.567442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.567753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.567753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.567970] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.568127] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.568199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.568383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.568460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.568665] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.568772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.568813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.568963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.569058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.569259] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.569352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.569434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.569625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.569661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.569747] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be created. [ 641.636128] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.636128] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.636128] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.639313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.640259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.667683] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 641.827776] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b9407cd-9840-4007-94e0-c8c2e0130658 [ 641.829303] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.829303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.829303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.830354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.830610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.830709] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b9407cd-9840-4007-94e0-c8c2e0130658 already deleted. [ 641.831698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b9407cd-9840-4007-94e0-c8c2e0130658" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.902344] env[69491]: INFO networking_nsxv3.common.synchronization [req-3bd43af5-10ef-4ec6-8a7a-606197b55fa5 req-f5f4b8f7-f880-4fbc-8111-f8a98db1bbd1 service nova] Enqueued Resource ID: 745f6209-d9d3-480b-9445-604b9585bfe0 with Priority: HIGHEST for action security_group_rules [ 641.902631] env[69491]: INFO networking_nsxv3.common.synchronization [req-3bd43af5-10ef-4ec6-8a7a-606197b55fa5 req-f5f4b8f7-f880-4fbc-8111-f8a98db1bbd1 service nova] Enqueued Resource ID: 745f6209-d9d3-480b-9445-604b9585bfe0 with Priority: HIGHEST for action security_group_members [ 641.902832] env[69491]: INFO networking_nsxv3.common.synchronization [req-3bd43af5-10ef-4ec6-8a7a-606197b55fa5 req-f5f4b8f7-f880-4fbc-8111-f8a98db1bbd1 service nova] Enqueued Resource ID: 7af0c7c0-c53b-4470-8ec3-3a442684f497 with Priority: HIGHEST for action port [ 641.903423] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745f6209-d9d3-480b-9445-604b9585bfe0 with Priority: HIGHEST for action security_group_rules [ 641.903575] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745f6209-d9d3-480b-9445-604b9585bfe0 with Priority: HIGHEST for action security_group_members [ 641.903651] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af0c7c0-c53b-4470-8ec3-3a442684f497 with Priority: HIGHEST for action port [ 641.905913] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-745f6209-d9d3-480b-9445-604b9585bfe0 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.905913] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.905913] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.905913] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.905913] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('745f6209-d9d3-480b-9445-604b9585bfe0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.906688] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-745f6209-d9d3-480b-9445-604b9585bfe0 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.907448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.907448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.907448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.907448] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.907448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.907812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.907812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.907812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.907812] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745f6209-d9d3-480b-9445-604b9585bfe0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.911892] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-7af0c7c0-c53b-4470-8ec3-3a442684f497 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.911892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7af0c7c0-c53b-4470-8ec3-3a442684f497" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.911892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7af0c7c0-c53b-4470-8ec3-3a442684f497" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.911892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7af0c7c0-c53b-4470-8ec3-3a442684f497" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.911892] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7af0c7c0-c53b-4470-8ec3-3a442684f497',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.029193] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf in Status: SUCCESS [ 642.029599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.045305] env[69491]: INFO networking_nsxv3.common.synchronization [req-1eb5c796-0da0-4398-b8dc-e90b61d59092 req-d1306354-35b3-4d7e-9b3e-4a5bfa6d330e service nova] Enqueued Resource ID: 24376446-4b3c-421b-a079-0ca7bece8e3b with Priority: HIGHEST for action security_group_rules [ 642.045305] env[69491]: INFO networking_nsxv3.common.synchronization [req-1eb5c796-0da0-4398-b8dc-e90b61d59092 req-d1306354-35b3-4d7e-9b3e-4a5bfa6d330e service nova] Enqueued Resource ID: 24376446-4b3c-421b-a079-0ca7bece8e3b with Priority: HIGHEST for action security_group_members [ 642.045305] env[69491]: INFO networking_nsxv3.common.synchronization [req-1eb5c796-0da0-4398-b8dc-e90b61d59092 req-d1306354-35b3-4d7e-9b3e-4a5bfa6d330e service nova] Enqueued Resource ID: 2c7dbcfd-a9a9-495e-82eb-f51c91989ffc with Priority: HIGHEST for action port [ 642.045305] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24376446-4b3c-421b-a079-0ca7bece8e3b with Priority: HIGHEST for action security_group_rules [ 642.045305] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24376446-4b3c-421b-a079-0ca7bece8e3b with Priority: HIGHEST for action security_group_members [ 642.045305] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c7dbcfd-a9a9-495e-82eb-f51c91989ffc with Priority: HIGHEST for action port [ 642.045305] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24376446-4b3c-421b-a079-0ca7bece8e3b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.045668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.045668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.045915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.045915] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24376446-4b3c-421b-a079-0ca7bece8e3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.047160] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-24376446-4b3c-421b-a079-0ca7bece8e3b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.047290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.047360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.047548] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.047777] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.047898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.047963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.048165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.048290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.048411] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24376446-4b3c-421b-a079-0ca7bece8e3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.055035] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c7dbcfd-a9a9-495e-82eb-f51c91989ffc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.055265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c7dbcfd-a9a9-495e-82eb-f51c91989ffc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.055349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c7dbcfd-a9a9-495e-82eb-f51c91989ffc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.055646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c7dbcfd-a9a9-495e-82eb-f51c91989ffc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.055891] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c7dbcfd-a9a9-495e-82eb-f51c91989ffc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.195625] env[69491]: INFO networking_nsxv3.common.synchronization [None req-34337014-f096-4b15-b91f-ced841587a74 tempest-ServersTestJSON-1393834495 tempest-ServersTestJSON-1393834495-project-member] Enqueued Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGHEST for action security_group_rules [ 642.196231] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGHEST for action security_group_rules [ 642.196678] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b70dddfb-485a-4313-8569-7ab012c8dc7e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.196824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.196824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.197094] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.197201] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b70dddfb-485a-4313-8569-7ab012c8dc7e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.407316] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-745f6209-d9d3-480b-9445-604b9585bfe0 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.407420] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.415463] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7af0c7c0-c53b-4470-8ec3-3a442684f497 with status ACTIVE [ 642.415652] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.415801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.415872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.416126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.416228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.416409] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.416595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.416595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.416824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.416883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.417517] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.417517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.417517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.417517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.417517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.417902] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7af0c7c0-c53b-4470-8ec3-3a442684f497 is going to be updated. [ 642.423379] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('745f6209-d9d3-480b-9445-604b9585bfe0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.446645] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.450356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.450356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.450356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.450356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.450356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7af0c7c0-c53b-4470-8ec3-3a442684f497" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.529087] env[69491]: INFO networking_nsxv3.common.synchronization [None req-2dbb23c6-0509-4277-8f7e-f0d1d30d6170 tempest-ServersTestJSON-1393834495 tempest-ServersTestJSON-1393834495-project-member] Enqueued Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGHEST for action security_group_rules [ 642.529849] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGHEST for action security_group_rules [ 642.530701] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b70dddfb-485a-4313-8569-7ab012c8dc7e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.530701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.556284] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24376446-4b3c-421b-a079-0ca7bece8e3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.558071] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-24376446-4b3c-421b-a079-0ca7bece8e3b taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.558071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.558850] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c7dbcfd-a9a9-495e-82eb-f51c91989ffc with status ACTIVE [ 642.558850] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.558850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.558850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.559099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.559099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.559647] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.559647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.559647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.559647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.559900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.559900] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.559985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.560074] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.560205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.560292] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.560340] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c7dbcfd-a9a9-495e-82eb-f51c91989ffc is going to be updated. [ 642.589389] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.591054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.591054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.591054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.591054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.591054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c7dbcfd-a9a9-495e-82eb-f51c91989ffc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.730994] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.731210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.734103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.734103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.734103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.734103] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b70dddfb-485a-4313-8569-7ab012c8dc7e already deleted. [ 642.734103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.734103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.734103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.734103] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b70dddfb-485a-4313-8569-7ab012c8dc7e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.902274] env[69491]: INFO networking_nsxv3.common.synchronization [req-4276f6f4-d5ff-4175-9960-ce05b4753ed6 req-aded78db-6253-4e41-9f16-a35b6c779ba9 tempest-TenantUsagesTestJSON-1735080768 tempest-TenantUsagesTestJSON-1735080768-project-member] Enqueued Resource ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 with Priority: HIGHEST for action security_group_members [ 642.903192] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 with Priority: HIGHEST for action security_group_members [ 642.903515] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-36f74a30-d3ec-48c5-8573-1f7852cad1f9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.903686] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.903744] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.904195] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.904195] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.904320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.904320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.904631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.904631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.904631] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36f74a30-d3ec-48c5-8573-1f7852cad1f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.923551] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('745f6209-d9d3-480b-9445-604b9585bfe0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.059577] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24376446-4b3c-421b-a079-0ca7bece8e3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.261024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.261024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.261024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.261024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.261024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.261024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b70dddfb-485a-4313-8569-7ab012c8dc7e already deleted. [ 643.261024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.408790] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.409045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.409112] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.409557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.409557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.409765] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.409843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.412520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.412520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.412520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.412520] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 already deleted. [ 643.412520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.424604] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.424726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.424726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.425122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.425238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.425336] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745f6209-d9d3-480b-9445-604b9585bfe0 is going to be created. [ 643.454082] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.454440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.454988] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.455603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.456902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.467461] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745f6209-d9d3-480b-9445-604b9585bfe0 in Status: UNINITIALIZED for 2s [ 643.562215] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.562397] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.562449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.564754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.564754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.564754] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24376446-4b3c-421b-a079-0ca7bece8e3b is going to be created. [ 643.593847] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.595378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.595378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.595378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.595378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.606930] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24376446-4b3c-421b-a079-0ca7bece8e3b in Status: UNINITIALIZED for 2s [ 643.622643] env[69491]: INFO networking_nsxv3.common.synchronization [None req-4ed1170b-802d-4ba5-8bf0-c53ce6e717de None None] Enqueued Resource ID: 3cb4773a-4e49-4052-abcf-72c1a77ef6e5 with Priority: HIGHEST for action port [ 643.622865] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb4773a-4e49-4052-abcf-72c1a77ef6e5 with Priority: HIGHEST for action port [ 643.623409] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cb4773a-4e49-4052-abcf-72c1a77ef6e5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.623700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cb4773a-4e49-4052-abcf-72c1a77ef6e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.624034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cb4773a-4e49-4052-abcf-72c1a77ef6e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.624600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cb4773a-4e49-4052-abcf-72c1a77ef6e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.624796] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb4773a-4e49-4052-abcf-72c1a77ef6e5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.670026] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.670026] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.670026] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.670026] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.670026] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.670026] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.670026] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.670026] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.670026] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.670026] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.670026] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.670026] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.670026] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.670801] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.670801] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.670801] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.686171] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 643.686171] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.692818] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.693019] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 643.693156] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.693335] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.693657] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.693820] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.693940] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.694332] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.694507] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.130239] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cb4773a-4e49-4052-abcf-72c1a77ef6e5 [ 644.130239] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.130239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.130239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.130239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.130239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.130239] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cb4773a-4e49-4052-abcf-72c1a77ef6e5 already deleted. [ 644.130239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cb4773a-4e49-4052-abcf-72c1a77ef6e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.202142] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.202482] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.202595] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.202996] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.203284] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.203455] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3 not found, creating... [ 644.203787] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.203986] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.204138] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.204470] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.204676] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.205754] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.205985] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.206142] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.206410] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.206638] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.206869] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3 is going to be created. [ 644.260148] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.260148] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.260148] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.260148] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.260148] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.260148] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.328448] env[69491]: INFO networking_nsxv3.common.synchronization [req-3ff24723-a54b-4a55-88cd-7099bd5d9bde req-34453401-c2c1-479e-b74a-a0cbfa7f5148 tempest-ServerActionsTestOtherB-761111206 tempest-ServerActionsTestOtherB-761111206-project-member] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 644.330041] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 644.330552] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.330847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.330847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.333348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.333348] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.333348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.333348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.333348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.333348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.333348] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.835096] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.835286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.835524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.835607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.835699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.835921] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.836041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.836094] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.836273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.836352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.836440] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 already deleted. [ 644.836544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.152494] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.153070] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.153426] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.153845] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.154233] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.154482] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.154653] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.157930] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.157930] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.157930] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.157930] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.157930] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.157930] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.157930] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.157930] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.157930] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.180520] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.180805] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 645.181064] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.181252] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.181655] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-eeddfdf1-1963-4ea9-818a-acfb042009ac taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.181917] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-eeddfdf1-1963-4ea9-818a-acfb042009ac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.185465] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-eeddfdf1-1963-4ea9-818a-acfb042009ac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.185465] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-eeddfdf1-1963-4ea9-818a-acfb042009ac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.185465] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeddfdf1-1963-4ea9-818a-acfb042009ac',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.192796] env[69491]: INFO networking_nsxv3.common.synchronization [None req-1ab4220c-d817-4b8a-93f3-8fd62dba52c0 tempest-ServersWithSpecificFlavorTestJSON-938071933 tempest-ServersWithSpecificFlavorTestJSON-938071933-project-member] Enqueued Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_rules [ 645.195044] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_rules [ 645.195044] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.195044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.195044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.195044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.195044] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.316550] env[69491]: INFO networking_nsxv3.common.synchronization [None req-2998e3df-2014-45cb-bfaf-3fb35288f722 tempest-ServersWithSpecificFlavorTestJSON-938071933 tempest-ServersWithSpecificFlavorTestJSON-938071933-project-member] Enqueued Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_rules [ 645.317163] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_rules [ 645.317451] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.317867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.477175] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745f6209-d9d3-480b-9445-604b9585bfe0 in Status: SUCCESS [ 645.477403] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.477573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.477794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.478090] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.478175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.478211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.478362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.478443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.478529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.478619] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('745f6209-d9d3-480b-9445-604b9585bfe0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.622031] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24376446-4b3c-421b-a079-0ca7bece8e3b in Status: SUCCESS [ 645.622248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.622777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.622954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.623180] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.623298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.623361] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.623526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.623600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.623683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.623832] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24376446-4b3c-421b-a079-0ca7bece8e3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.689343] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.689343] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.689343] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.689343] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.689343] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.689343] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port eeddfdf1-1963-4ea9-818a-acfb042009ac not found, creating... [ 645.689343] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.689343] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.689343] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.689343] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.689343] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.689868] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.689868] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.689868] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.689868] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.690185] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.691338] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: eeddfdf1-1963-4ea9-818a-acfb042009ac is going to be created. [ 645.714604] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.715288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.715288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.715288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.715288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.715288] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53902bde-30e4-44b3-9472-853fecdeacca already deleted. [ 645.715582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.715809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.715984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.716094] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.720061] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.720061] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.720061] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.720061] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.720061] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.720453] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-eeddfdf1-1963-4ea9-818a-acfb042009ac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.981154] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-745f6209-d9d3-480b-9445-604b9585bfe0 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.981154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.981154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.981345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.981404] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.981486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.981541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.981716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.981971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.981971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.981971] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-745f6209-d9d3-480b-9445-604b9585bfe0 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.982239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.982239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.982370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.982446] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.982515] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.982569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.982795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.982795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.982913] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.982913] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('745f6209-d9d3-480b-9445-604b9585bfe0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.024946] env[69491]: INFO networking_nsxv3.common.synchronization [req-4276f6f4-d5ff-4175-9960-ce05b4753ed6 req-380b243c-cc93-4223-8545-fd7840c39245 service nova] Enqueued Resource ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 with Priority: HIGHEST for action security_group_rules [ 646.025185] env[69491]: INFO networking_nsxv3.common.synchronization [req-4276f6f4-d5ff-4175-9960-ce05b4753ed6 req-380b243c-cc93-4223-8545-fd7840c39245 service nova] Enqueued Resource ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 with Priority: HIGHEST for action security_group_members [ 646.025352] env[69491]: INFO networking_nsxv3.common.synchronization [req-4276f6f4-d5ff-4175-9960-ce05b4753ed6 req-380b243c-cc93-4223-8545-fd7840c39245 service nova] Enqueued Resource ID: 69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3 with Priority: HIGHEST for action port [ 646.025839] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 with Priority: HIGHEST for action security_group_rules [ 646.025976] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 with Priority: HIGHEST for action security_group_members [ 646.026216] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3 with Priority: HIGHEST for action port [ 646.026510] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36f74a30-d3ec-48c5-8573-1f7852cad1f9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.026630] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.026708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.026957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.027111] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36f74a30-d3ec-48c5-8573-1f7852cad1f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.027927] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-36f74a30-d3ec-48c5-8573-1f7852cad1f9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.028071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.028146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.028305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.028451] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.028546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.028608] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.028750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.028848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.028910] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36f74a30-d3ec-48c5-8573-1f7852cad1f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.029622] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.033108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.033108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.033108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.033108] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.131041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-24376446-4b3c-421b-a079-0ca7bece8e3b taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.131041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.131041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.131898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.131898] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.131898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.131898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.131898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.132375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.132529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.132594] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-24376446-4b3c-421b-a079-0ca7bece8e3b taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.132924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.132924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.132924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.133183] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.133278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.133701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.133701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.133701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.133701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.133957] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24376446-4b3c-421b-a079-0ca7bece8e3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.252392] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.252392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.252392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.252392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.252392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.252392] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53902bde-30e4-44b3-9472-853fecdeacca already deleted. [ 646.252392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.489793] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 745f6209-d9d3-480b-9445-604b9585bfe0: rpc.has_security_group_logging(os_id): False [ 646.512285] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.512285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.512285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.512285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.512285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.512285] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.512285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.512285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.512285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.512285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.512285] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.512285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.512285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.513279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.513580] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.516421] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.516421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.516421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.516421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.516421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.516421] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 745f6209-d9d3-480b-9445-604b9585bfe0 is going to be created. [ 646.535028] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36f74a30-d3ec-48c5-8573-1f7852cad1f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.535028] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-36f74a30-d3ec-48c5-8573-1f7852cad1f9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.535028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.535028] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3 with status ACTIVE [ 646.535028] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.535028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.535028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.535028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.535028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.536437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.536683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.536683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.536848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.536899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.537155] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.537290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.537613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.537613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.537613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.537613] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3 is going to be updated. [ 646.559482] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.559784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.559784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.559917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.560077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.560460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69947e7c-1fb8-4e3f-b0b2-e74b8fcd4ae3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.594698] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.594875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.594914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.595481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.595481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.608645] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 745f6209-d9d3-480b-9445-604b9585bfe0 in Status: IN_PROGRESS for 2s [ 646.638942] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24376446-4b3c-421b-a079-0ca7bece8e3b: rpc.has_security_group_logging(os_id): False [ 646.670827] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.671255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.671255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.671382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.671382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.671646] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.671792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.671792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.671938] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.671990] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.672201] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.672291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.672347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.672491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.672566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.672743] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.672831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.672996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.673444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.673501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.673598] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24376446-4b3c-421b-a079-0ca7bece8e3b is going to be created. [ 646.809125] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.809353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.809353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.810307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.810307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.823451] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24376446-4b3c-421b-a079-0ca7bece8e3b in Status: IN_PROGRESS for 2s [ 646.901858] env[69491]: INFO networking_nsxv3.common.synchronization [req-925401d3-94df-4271-9e8c-80b4648de1f0 req-9a78d2f1-5e05-4a68-aa21-a672873c57c5 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: f1812f0f-128b-41f6-987e-18e589d1ef41 with Priority: HIGHEST for action security_group_members [ 646.904832] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1812f0f-128b-41f6-987e-18e589d1ef41 with Priority: HIGHEST for action security_group_members [ 646.904832] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1812f0f-128b-41f6-987e-18e589d1ef41 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.904832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.904832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.904832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.904832] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.904832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.904832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.907905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.907905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.907905] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1812f0f-128b-41f6-987e-18e589d1ef41',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.035749] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36f74a30-d3ec-48c5-8573-1f7852cad1f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.316030] env[69491]: INFO networking_nsxv3.common.synchronization [req-3ff24723-a54b-4a55-88cd-7099bd5d9bde req-9c72e819-375d-4ffa-8acd-26b78ad84b83 service nova] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_rules [ 647.316699] env[69491]: INFO networking_nsxv3.common.synchronization [req-3ff24723-a54b-4a55-88cd-7099bd5d9bde req-9c72e819-375d-4ffa-8acd-26b78ad84b83 service nova] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 647.316699] env[69491]: INFO networking_nsxv3.common.synchronization [req-3ff24723-a54b-4a55-88cd-7099bd5d9bde req-9c72e819-375d-4ffa-8acd-26b78ad84b83 service nova] Enqueued Resource ID: eeddfdf1-1963-4ea9-818a-acfb042009ac with Priority: HIGHEST for action port [ 647.319830] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_rules [ 647.319986] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 647.320126] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeddfdf1-1963-4ea9-818a-acfb042009ac with Priority: HIGHEST for action port [ 647.321285] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.321424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.323163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.323163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.323163] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.323163] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.323163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.323163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.325762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.325834] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.326056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.326056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.326406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.326406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.326506] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.327825] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-eeddfdf1-1963-4ea9-818a-acfb042009ac taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.327825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eeddfdf1-1963-4ea9-818a-acfb042009ac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.327825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eeddfdf1-1963-4ea9-818a-acfb042009ac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.327825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eeddfdf1-1963-4ea9-818a-acfb042009ac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.327825] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeddfdf1-1963-4ea9-818a-acfb042009ac',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.369233] env[69491]: INFO networking_nsxv3.common.synchronization [None req-a07aa0f5-c90a-479f-a038-8674cf4758b0 None None] Enqueued Resource ID: ff1a60f1-5bdf-474a-92d8-6932f716eb93 with Priority: HIGHEST for action port [ 647.370096] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff1a60f1-5bdf-474a-92d8-6932f716eb93 with Priority: HIGHEST for action port [ 647.370441] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff1a60f1-5bdf-474a-92d8-6932f716eb93 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.370661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff1a60f1-5bdf-474a-92d8-6932f716eb93" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.370661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff1a60f1-5bdf-474a-92d8-6932f716eb93" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.371090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff1a60f1-5bdf-474a-92d8-6932f716eb93" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.371211] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff1a60f1-5bdf-474a-92d8-6932f716eb93',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.410529] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.411043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.411043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.411043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.411230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.412508] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.412508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.412508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.412508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.412508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.412508] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1812f0f-128b-41f6-987e-18e589d1ef41 already deleted. [ 647.412508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.539946] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.539946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.539946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.539946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.540296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.540296] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 is going to be created. [ 647.568866] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.568976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.569047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.569265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.569437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.581092] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 in Status: UNINITIALIZED for 2s [ 647.829770] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.829949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.830138] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.833046] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eeddfdf1-1963-4ea9-818a-acfb042009ac with status ACTIVE [ 647.833259] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.833386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.833448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.833657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.833749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.833937] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.834012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.834073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.834223] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.834298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.836836] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.837031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.837125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.837306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.837387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.837478] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eeddfdf1-1963-4ea9-818a-acfb042009ac is going to be updated. [ 647.862075] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.863428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.863428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.863428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.863428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.863428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eeddfdf1-1963-4ea9-818a-acfb042009ac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.875160] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff1a60f1-5bdf-474a-92d8-6932f716eb93 [ 647.875160] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.875160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.875160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.875160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.875160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.875160] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff1a60f1-5bdf-474a-92d8-6932f716eb93 already deleted. [ 647.875160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff1a60f1-5bdf-474a-92d8-6932f716eb93" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.184022] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.184022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.184022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.184022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.184022] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.184022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.184022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.184022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.184022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.184022] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.184654] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.184881] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.185070] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.185212] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.185399] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.185631] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.209300] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.209792] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.211872] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.211872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.211872] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-10688c4f-0b3c-436b-83e3-1375e004b440 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.211872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-10688c4f-0b3c-436b-83e3-1375e004b440" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.211872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-10688c4f-0b3c-436b-83e3-1375e004b440" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.211872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-10688c4f-0b3c-436b-83e3-1375e004b440" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.211872] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10688c4f-0b3c-436b-83e3-1375e004b440',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.333914] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.474529] env[69491]: INFO networking_nsxv3.common.synchronization [None req-8aa5eeb0-5112-40e1-b863-bdf20ead9255 None None] Enqueued Resource ID: 9ff831fa-41bd-4abf-a3fd-89879b552a91 with Priority: HIGHEST for action port [ 648.475305] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ff831fa-41bd-4abf-a3fd-89879b552a91 with Priority: HIGHEST for action port [ 648.475749] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ff831fa-41bd-4abf-a3fd-89879b552a91 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.475914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ff831fa-41bd-4abf-a3fd-89879b552a91" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.475987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ff831fa-41bd-4abf-a3fd-89879b552a91" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.476687] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ff831fa-41bd-4abf-a3fd-89879b552a91" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.476801] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ff831fa-41bd-4abf-a3fd-89879b552a91',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.621285] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 745f6209-d9d3-480b-9445-604b9585bfe0 in Status: SUCCESS [ 648.621731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.716385] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.716756] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.718636] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.718636] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.718636] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.718636] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 10688c4f-0b3c-436b-83e3-1375e004b440 not found, creating... [ 648.718636] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.719201] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.719374] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.719841] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.719995] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.720347] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.720695] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.720872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.721147] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.721358] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.721435] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 10688c4f-0b3c-436b-83e3-1375e004b440 is going to be created. [ 648.747408] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.748350] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.748350] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.748583] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.749854] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.749854] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-10688c4f-0b3c-436b-83e3-1375e004b440" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.844022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.844022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.844022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.844022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.844022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.844022] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be created. [ 648.849310] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24376446-4b3c-421b-a079-0ca7bece8e3b in Status: SUCCESS [ 648.849395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.876683] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.877249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.877443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.877883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.881935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.893849] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: UNINITIALIZED for 2s [ 648.981210] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ff831fa-41bd-4abf-a3fd-89879b552a91 [ 648.981210] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.981210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.981210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.981210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.981210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.981210] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ff831fa-41bd-4abf-a3fd-89879b552a91 already deleted. [ 648.981210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ff831fa-41bd-4abf-a3fd-89879b552a91" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.593716] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 in Status: SUCCESS [ 649.594085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.594157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.594506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.594620] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.594711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.594711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.596313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.596313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.596313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.596313] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('36f74a30-d3ec-48c5-8573-1f7852cad1f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.935563] env[69491]: INFO networking_nsxv3.common.synchronization [None req-1e3b99c9-032a-4db6-8ec0-d9b21155d87e None None] Enqueued Resource ID: a923fe39-bccc-439a-a01e-0b04673442e4 with Priority: HIGHEST for action port [ 649.935837] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a923fe39-bccc-439a-a01e-0b04673442e4 with Priority: HIGHEST for action port [ 649.936483] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-a923fe39-bccc-439a-a01e-0b04673442e4 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.937309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a923fe39-bccc-439a-a01e-0b04673442e4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.937309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a923fe39-bccc-439a-a01e-0b04673442e4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.937714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a923fe39-bccc-439a-a01e-0b04673442e4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.937813] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a923fe39-bccc-439a-a01e-0b04673442e4',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.098417] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-36f74a30-d3ec-48c5-8573-1f7852cad1f9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.098417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.098417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.098417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.098776] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.098776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.098878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.099016] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.099119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.099235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.099441] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-36f74a30-d3ec-48c5-8573-1f7852cad1f9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.099547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.099606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.099771] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.099929] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.100169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.100169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.100939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.100939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.100939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.100939] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('36f74a30-d3ec-48c5-8573-1f7852cad1f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.237089] env[69491]: INFO networking_nsxv3.common.synchronization [None req-e7afd99f-f9b9-4b24-90bb-be6f60c70cdc None None] Enqueued Resource ID: ef394be3-d4a3-461c-997c-dd88c42bf731 with Priority: HIGHEST for action port [ 650.237730] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef394be3-d4a3-461c-997c-dd88c42bf731 with Priority: HIGHEST for action port [ 650.238639] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef394be3-d4a3-461c-997c-dd88c42bf731 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.238793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef394be3-d4a3-461c-997c-dd88c42bf731" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.238859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef394be3-d4a3-461c-997c-dd88c42bf731" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.239158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef394be3-d4a3-461c-997c-dd88c42bf731" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.239234] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef394be3-d4a3-461c-997c-dd88c42bf731',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.444144] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a923fe39-bccc-439a-a01e-0b04673442e4 [ 650.444144] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.444144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.444144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.444144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.444144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.444144] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a923fe39-bccc-439a-a01e-0b04673442e4 already deleted. [ 650.444144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a923fe39-bccc-439a-a01e-0b04673442e4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.445217] env[69491]: INFO networking_nsxv3.common.synchronization [req-925401d3-94df-4271-9e8c-80b4648de1f0 req-34d0c4f8-855d-4b0b-8e15-5f2294bb83d5 service nova] Enqueued Resource ID: f1812f0f-128b-41f6-987e-18e589d1ef41 with Priority: HIGHEST for action security_group_rules [ 650.445217] env[69491]: INFO networking_nsxv3.common.synchronization [req-925401d3-94df-4271-9e8c-80b4648de1f0 req-34d0c4f8-855d-4b0b-8e15-5f2294bb83d5 service nova] Enqueued Resource ID: f1812f0f-128b-41f6-987e-18e589d1ef41 with Priority: HIGHEST for action security_group_members [ 650.445217] env[69491]: INFO networking_nsxv3.common.synchronization [req-925401d3-94df-4271-9e8c-80b4648de1f0 req-34d0c4f8-855d-4b0b-8e15-5f2294bb83d5 service nova] Enqueued Resource ID: 10688c4f-0b3c-436b-83e3-1375e004b440 with Priority: HIGHEST for action port [ 650.445783] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1812f0f-128b-41f6-987e-18e589d1ef41 with Priority: HIGHEST for action security_group_rules [ 650.445943] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1812f0f-128b-41f6-987e-18e589d1ef41 with Priority: HIGHEST for action security_group_members [ 650.446082] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10688c4f-0b3c-436b-83e3-1375e004b440 with Priority: HIGHEST for action port [ 650.446367] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1812f0f-128b-41f6-987e-18e589d1ef41 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.446489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.446556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.446822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.446822] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1812f0f-128b-41f6-987e-18e589d1ef41',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.449529] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1812f0f-128b-41f6-987e-18e589d1ef41 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.449529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.449529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.449529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.449529] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.449529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.449529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.449529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.449529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.449529] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1812f0f-128b-41f6-987e-18e589d1ef41',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.454879] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-10688c4f-0b3c-436b-83e3-1375e004b440 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.454879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10688c4f-0b3c-436b-83e3-1375e004b440" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.454879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10688c4f-0b3c-436b-83e3-1375e004b440" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.454879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10688c4f-0b3c-436b-83e3-1375e004b440" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.454879] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10688c4f-0b3c-436b-83e3-1375e004b440',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.604658] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 36f74a30-d3ec-48c5-8573-1f7852cad1f9: rpc.has_security_group_logging(os_id): False [ 650.627173] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.627173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.627173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.627173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.627173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.627173] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.627173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.627173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.627173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.627673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.627673] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.627673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.627784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.628150] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.628899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.629168] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.629275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.629427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.629648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.629744] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.629836] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 is going to be created. [ 650.701263] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.701522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.701522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.701922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.701922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.718185] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 in Status: IN_PROGRESS for 2s [ 650.740914] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef394be3-d4a3-461c-997c-dd88c42bf731 [ 650.741773] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.741773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.741773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.741773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.741773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.742083] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef394be3-d4a3-461c-997c-dd88c42bf731 already deleted. [ 650.742083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef394be3-d4a3-461c-997c-dd88c42bf731" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.903931] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 650.904812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.905242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.905716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.905875] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.906021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.906131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.906449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.906449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.906449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.906575] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.954556] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1812f0f-128b-41f6-987e-18e589d1ef41 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.954556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.955225] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1812f0f-128b-41f6-987e-18e589d1ef41',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.955733] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10688c4f-0b3c-436b-83e3-1375e004b440 with status ACTIVE [ 650.955932] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.956074] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.956138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.956491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.959148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.959148] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.959148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.959148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.959148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.959148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.959148] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.959148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.959148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.959148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.959148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.959148] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10688c4f-0b3c-436b-83e3-1375e004b440 is going to be updated. [ 650.983743] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.983743] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.983743] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.983743] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.983743] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.983743] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10688c4f-0b3c-436b-83e3-1375e004b440" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.095667] env[69491]: INFO networking_nsxv3.common.synchronization [None req-bb369a5f-8feb-4f1c-ba9c-f1f30c44ffa0 None None] Enqueued Resource ID: 5e3ffa2a-7696-4f93-8f2d-33f562d7fd28 with Priority: HIGHEST for action port [ 651.096962] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3ffa2a-7696-4f93-8f2d-33f562d7fd28 with Priority: HIGHEST for action port [ 651.097650] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e3ffa2a-7696-4f93-8f2d-33f562d7fd28 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.097650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e3ffa2a-7696-4f93-8f2d-33f562d7fd28" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.097759] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e3ffa2a-7696-4f93-8f2d-33f562d7fd28" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.099431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e3ffa2a-7696-4f93-8f2d-33f562d7fd28" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.099431] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e3ffa2a-7696-4f93-8f2d-33f562d7fd28',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.410475] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.461410] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1812f0f-128b-41f6-987e-18e589d1ef41',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.604265] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e3ffa2a-7696-4f93-8f2d-33f562d7fd28 [ 651.604265] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.604500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.604500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.604581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.604679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.604911] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e3ffa2a-7696-4f93-8f2d-33f562d7fd28 already deleted. [ 651.604911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e3ffa2a-7696-4f93-8f2d-33f562d7fd28" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.913874] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fd20800-5a4b-495c-a02a-35b10f00ea55: rpc.has_security_group_logging(os_id): False [ 651.936024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.936024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.936024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.936024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.936024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.936024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.936024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.936024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.936024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.936024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.936024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be created. [ 651.965517] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.968142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.968142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.968142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.968142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.968142] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1812f0f-128b-41f6-987e-18e589d1ef41 is going to be created. [ 651.988818] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.990326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.990402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.990619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.990781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.002309] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1812f0f-128b-41f6-987e-18e589d1ef41 in Status: UNINITIALIZED for 2s [ 652.006964] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.007101] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.007196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.007461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.007581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.023018] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 652.427676] env[69491]: INFO networking_nsxv3.common.synchronization [None req-4a0a4c40-d665-41ad-83bf-2e85e3da0f88 None None] Enqueued Resource ID: d555afdc-4f9f-4e52-b1b4-5e3a5cb3bc35 with Priority: HIGHEST for action port [ 652.428395] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d555afdc-4f9f-4e52-b1b4-5e3a5cb3bc35 with Priority: HIGHEST for action port [ 652.428738] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d555afdc-4f9f-4e52-b1b4-5e3a5cb3bc35 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.428907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d555afdc-4f9f-4e52-b1b4-5e3a5cb3bc35" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.428961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d555afdc-4f9f-4e52-b1b4-5e3a5cb3bc35" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.429862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d555afdc-4f9f-4e52-b1b4-5e3a5cb3bc35" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.430417] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d555afdc-4f9f-4e52-b1b4-5e3a5cb3bc35',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.520566] env[69491]: INFO networking_nsxv3.common.synchronization [req-5741e17a-02f2-4aac-a0fa-e4957c03398e req-72564929-b9b2-464f-8c75-a82708e74e48 tempest-DeleteServersAdminTestJSON-1258933062 tempest-DeleteServersAdminTestJSON-1258933062-project-admin] Enqueued Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_members [ 652.521288] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_members [ 652.521651] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.521856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.521951] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.523177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.523177] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.523177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.523177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.523177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.523177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.523177] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.738835] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 in Status: SUCCESS [ 652.740292] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.790919] env[69491]: INFO networking_nsxv3.common.synchronization [req-0dbbf104-9c10-45cf-b0e5-bc2c08d2dcdd req-9f90536d-5a9f-4ac4-8323-22db84914887 tempest-ImagesTestJSON-1178517317 tempest-ImagesTestJSON-1178517317-project-member] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 652.791385] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 652.795399] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.795399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.795399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.795399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.795399] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.795399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.795399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.803025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.803025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.803025] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.934542] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d555afdc-4f9f-4e52-b1b4-5e3a5cb3bc35 [ 652.934542] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.934542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.934542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.934542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.934542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.934542] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d555afdc-4f9f-4e52-b1b4-5e3a5cb3bc35 already deleted. [ 652.934542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d555afdc-4f9f-4e52-b1b4-5e3a5cb3bc35" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.031738] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.031738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.031738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.031738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.031738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.032134] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.032134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.032134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.032322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.032322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.032396] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 is going to be updated. [ 653.067530] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.067707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.067781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.068010] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.068220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.078243] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: IN_PROGRESS for 2s [ 653.303534] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.303712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.303774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.303998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.304103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.304305] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.304398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.304460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.304624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.304700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.304785] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 already deleted. [ 653.304864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.750386] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.750829] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.750829] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.751060] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.751273] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.752599] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.752599] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.752599] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.752599] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.752599] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.752599] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.755885] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.755885] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.755885] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.755885] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.755885] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.780058] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.780058] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 653.780058] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.780058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.780058] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-ec5f96e8-9f44-484b-9a0c-648d14d8ce3b taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.780058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-ec5f96e8-9f44-484b-9a0c-648d14d8ce3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.780058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-ec5f96e8-9f44-484b-9a0c-648d14d8ce3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.780058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-ec5f96e8-9f44-484b-9a0c-648d14d8ce3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.780058] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec5f96e8-9f44-484b-9a0c-648d14d8ce3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.018754] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1812f0f-128b-41f6-987e-18e589d1ef41 in Status: SUCCESS [ 654.018754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.018754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.018754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.018754] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.018754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.018754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.018754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.018754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.018754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.018754] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1812f0f-128b-41f6-987e-18e589d1ef41',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.034888] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 654.035175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.284678] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.285114] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.285283] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.285934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.286267] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.286457] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port ec5f96e8-9f44-484b-9a0c-648d14d8ce3b not found, creating... [ 654.286773] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.286938] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.287115] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.287422] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.287616] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.291372] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.291560] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.291690] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.291995] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.292164] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.292312] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: ec5f96e8-9f44-484b-9a0c-648d14d8ce3b is going to be created. [ 654.319730] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.319730] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.319940] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.320415] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.320514] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.320763] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-ec5f96e8-9f44-484b-9a0c-648d14d8ce3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.523654] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1812f0f-128b-41f6-987e-18e589d1ef41',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.946438] env[69491]: INFO networking_nsxv3.common.synchronization [None req-e715bda5-7542-49cb-9cab-e65f4bb87065 None None] Enqueued Resource ID: a9dfab08-5bfe-43c1-91d1-6c000e0e6bfc with Priority: HIGHEST for action port [ 654.946745] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dfab08-5bfe-43c1-91d1-6c000e0e6bfc with Priority: HIGHEST for action port [ 654.947402] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9dfab08-5bfe-43c1-91d1-6c000e0e6bfc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.949187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9dfab08-5bfe-43c1-91d1-6c000e0e6bfc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.949296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9dfab08-5bfe-43c1-91d1-6c000e0e6bfc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.949606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9dfab08-5bfe-43c1-91d1-6c000e0e6bfc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.949700] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9dfab08-5bfe-43c1-91d1-6c000e0e6bfc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.028762] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1812f0f-128b-41f6-987e-18e589d1ef41: rpc.has_security_group_logging(os_id): False [ 655.055461] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.055461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.055461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.055461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.055461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.055461] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.055461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.055461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.055461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.055461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.055461] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1812f0f-128b-41f6-987e-18e589d1ef41 is going to be created. [ 655.089118] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: SUCCESS [ 655.089952] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 deletion is rescheduled due to dependency. [ 655.089952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.128618] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.129295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.129445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.129733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.131348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.144751] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1812f0f-128b-41f6-987e-18e589d1ef41 in Status: IN_PROGRESS for 2s [ 655.453685] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9dfab08-5bfe-43c1-91d1-6c000e0e6bfc [ 655.453799] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.455072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.455072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.455072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.455072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.455072] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9dfab08-5bfe-43c1-91d1-6c000e0e6bfc already deleted. [ 655.455072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9dfab08-5bfe-43c1-91d1-6c000e0e6bfc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.643889] env[69491]: INFO networking_nsxv3.common.synchronization [req-0dbbf104-9c10-45cf-b0e5-bc2c08d2dcdd req-21884e9b-ffd8-4a16-9da6-48c590880ee9 service nova] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_rules [ 655.643889] env[69491]: INFO networking_nsxv3.common.synchronization [req-0dbbf104-9c10-45cf-b0e5-bc2c08d2dcdd req-21884e9b-ffd8-4a16-9da6-48c590880ee9 service nova] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 655.643889] env[69491]: INFO networking_nsxv3.common.synchronization [req-0dbbf104-9c10-45cf-b0e5-bc2c08d2dcdd req-21884e9b-ffd8-4a16-9da6-48c590880ee9 service nova] Enqueued Resource ID: ec5f96e8-9f44-484b-9a0c-648d14d8ce3b with Priority: HIGHEST for action port [ 655.643889] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_rules [ 655.643889] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 655.643889] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5f96e8-9f44-484b-9a0c-648d14d8ce3b with Priority: HIGHEST for action port [ 655.643889] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.643889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.643889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.645186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.645292] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.646978] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.647172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.647299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.647555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.647719] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.647819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.647882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.648093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.648153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.648409] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.650438] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec5f96e8-9f44-484b-9a0c-648d14d8ce3b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.650524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec5f96e8-9f44-484b-9a0c-648d14d8ce3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.650584] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec5f96e8-9f44-484b-9a0c-648d14d8ce3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.650818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec5f96e8-9f44-484b-9a0c-648d14d8ce3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.650909] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec5f96e8-9f44-484b-9a0c-648d14d8ce3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.769227] env[69491]: INFO networking_nsxv3.common.synchronization [req-5f1f1dc2-19ac-4e13-bf31-2676dad9313d req-7efd60d1-e9e4-404b-9fde-56683d9ee22b tempest-MigrationsAdminTest-1576792364 tempest-MigrationsAdminTest-1576792364-project-member] Enqueued Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_members [ 655.770284] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_members [ 655.771184] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.771184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.771184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.771184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.771421] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.771537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.771660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.771891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.771891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.772033] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.876282] env[69491]: INFO networking_nsxv3.common.synchronization [req-806ba98f-12cf-42e8-9b94-43dc0cc36a11 req-96d8bc5a-b065-41fa-ac59-c3db5f886729 tempest-ServerExternalEventsTest-1587261735 tempest-ServerExternalEventsTest-1587261735-project-member] Enqueued Resource ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf with Priority: HIGHEST for action security_group_members [ 655.877103] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf with Priority: HIGHEST for action security_group_members [ 655.877218] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9023993-36fc-47c8-9c97-1eea2e87c7cf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.877281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.877425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.877572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.877735] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.877835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.877916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.878271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.878338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.878424] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9023993-36fc-47c8-9c97-1eea2e87c7cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.147706] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.149276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.153521] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.153521] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec5f96e8-9f44-484b-9a0c-648d14d8ce3b with status ACTIVE [ 656.153521] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.153849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.153849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.153967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.154027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.154711] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.154862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.154862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.155774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.155774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.155774] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.155774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.156447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.156668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.156725] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.156826] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec5f96e8-9f44-484b-9a0c-648d14d8ce3b is going to be updated. [ 656.183309] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.184520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.184875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.186203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.186203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.186203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec5f96e8-9f44-484b-9a0c-648d14d8ce3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.275871] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.276060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.276122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.276344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.276432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.276631] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.276737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.276791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.280024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.280024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.280024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57178755-8937-4ec8-907c-6e349b3947d2 already deleted. [ 656.280024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.302351] env[69491]: INFO networking_nsxv3.common.synchronization [req-558c5429-2de9-4336-9090-d9b1374d3ce4 req-8379485f-f40c-4c74-b19d-52a0abcb709b tempest-ServerDiagnosticsTest-1805878952 tempest-ServerDiagnosticsTest-1805878952-project-member] Enqueued Resource ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f with Priority: HIGHEST for action security_group_members [ 656.306138] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f with Priority: HIGHEST for action security_group_members [ 656.307012] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.307286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.307358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.307583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.307781] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.307883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.307950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.308313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.308445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.308557] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.383502] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.383502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.383502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.384838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.384838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.385086] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.385086] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.385191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.385575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.385575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.385736] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf is going to be updated. [ 656.426648] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.426648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.426867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.429715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.429715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.443809] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf in Status: IN_PROGRESS for 2s [ 656.610652] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.610866] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.610995] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.611317] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.611588] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.611749] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.611871] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.612556] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.612784] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.613026] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 656.613145] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.613258] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.613371] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.613484] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 656.613594] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.613728] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.641880] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.642135] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 656.642345] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.642808] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.643598] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-fcd19903-6f1e-4297-afc9-9decdfe37903 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.643732] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-fcd19903-6f1e-4297-afc9-9decdfe37903" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.643831] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-fcd19903-6f1e-4297-afc9-9decdfe37903" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.645219] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-fcd19903-6f1e-4297-afc9-9decdfe37903" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.648273] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcd19903-6f1e-4297-afc9-9decdfe37903',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.661607] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.813306] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.813306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.818309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.818309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.818309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.818309] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.818309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.818309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.818309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.818309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.818309] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f is going to be updated. [ 656.857302] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.857550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.857550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.861790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.861928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.873475] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f in Status: IN_PROGRESS for 2s [ 657.152639] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.154507] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.154507] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.154507] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.154507] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.154507] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port fcd19903-6f1e-4297-afc9-9decdfe37903 not found, creating... [ 657.154507] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.155567] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.155819] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.156260] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.157027] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.160223] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.160223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.160223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.160223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.160223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.160223] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: fcd19903-6f1e-4297-afc9-9decdfe37903 is going to be created. [ 657.160752] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1812f0f-128b-41f6-987e-18e589d1ef41 in Status: SUCCESS [ 657.161162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.165061] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.165061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.165248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.165576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.167030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.167030] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be created. [ 657.184952] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.184952] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.185132] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.185399] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.185640] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.185898] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-fcd19903-6f1e-4297-afc9-9decdfe37903" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.209491] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.209491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.209491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.210043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.210043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.231098] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: UNINITIALIZED for 2s [ 657.483388] env[69491]: INFO networking_nsxv3.common.synchronization [None req-2e807e92-39da-45c2-8a2c-4d39408f2053 None None] Enqueued Resource ID: b9811f85-47ad-4ab2-8ff8-cb0701e7bcaf with Priority: HIGHEST for action port [ 657.483849] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9811f85-47ad-4ab2-8ff8-cb0701e7bcaf with Priority: HIGHEST for action port [ 657.484335] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9811f85-47ad-4ab2-8ff8-cb0701e7bcaf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.484439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9811f85-47ad-4ab2-8ff8-cb0701e7bcaf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.484478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9811f85-47ad-4ab2-8ff8-cb0701e7bcaf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.485160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9811f85-47ad-4ab2-8ff8-cb0701e7bcaf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.485160] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9811f85-47ad-4ab2-8ff8-cb0701e7bcaf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.988850] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9811f85-47ad-4ab2-8ff8-cb0701e7bcaf [ 657.988850] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.988850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.988850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.989034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.989124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.989222] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9811f85-47ad-4ab2-8ff8-cb0701e7bcaf already deleted. [ 657.989388] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9811f85-47ad-4ab2-8ff8-cb0701e7bcaf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.320987] env[69491]: INFO networking_nsxv3.common.synchronization [req-5f1f1dc2-19ac-4e13-bf31-2676dad9313d req-a98351bb-04f9-4648-b26f-496f513397ea service nova] Enqueued Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_rules [ 658.321288] env[69491]: INFO networking_nsxv3.common.synchronization [req-5f1f1dc2-19ac-4e13-bf31-2676dad9313d req-a98351bb-04f9-4648-b26f-496f513397ea service nova] Enqueued Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_members [ 658.321410] env[69491]: INFO networking_nsxv3.common.synchronization [req-5f1f1dc2-19ac-4e13-bf31-2676dad9313d req-a98351bb-04f9-4648-b26f-496f513397ea service nova] Enqueued Resource ID: fcd19903-6f1e-4297-afc9-9decdfe37903 with Priority: HIGHEST for action port [ 658.323107] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_rules [ 658.323107] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_members [ 658.323107] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcd19903-6f1e-4297-afc9-9decdfe37903 with Priority: HIGHEST for action port [ 658.323653] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.323839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.324073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.324388] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.324498] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.326347] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.326505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.326568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.326772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.327330] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.327606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.327708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.328060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.328201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.328306] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.330135] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcd19903-6f1e-4297-afc9-9decdfe37903 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.332386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcd19903-6f1e-4297-afc9-9decdfe37903" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.332540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcd19903-6f1e-4297-afc9-9decdfe37903" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.332831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcd19903-6f1e-4297-afc9-9decdfe37903" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.332919] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcd19903-6f1e-4297-afc9-9decdfe37903',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.459494] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf in Status: SUCCESS [ 658.459759] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf deletion is rescheduled due to dependency. [ 658.459986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.481732] env[69491]: INFO networking_nsxv3.common.synchronization [req-b3e1c4fd-e97b-4771-9fc7-d15b87c23183 req-5d0b89ac-9d80-454d-8f08-290e43ec6e01 tempest-VolumesAssistedSnapshotsTest-139761842 tempest-VolumesAssistedSnapshotsTest-139761842-project-member] Enqueued Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGHEST for action security_group_members [ 658.483663] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGHEST for action security_group_members [ 658.484452] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-00540613-7092-4498-a250-9bb6d721591a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.484621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.484688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.485193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.485365] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.485473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.485538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.485692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.485787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.485863] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00540613-7092-4498-a250-9bb6d721591a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.768860] env[69491]: INFO networking_nsxv3.common.synchronization [None req-9a1dfce3-e997-4f4d-a083-ab2818fec4b7 None None] Enqueued Resource ID: 9aa69766-f825-4cbd-8575-b84500b37ef7 with Priority: HIGHEST for action port [ 658.769451] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aa69766-f825-4cbd-8575-b84500b37ef7 with Priority: HIGHEST for action port [ 658.769776] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-9aa69766-f825-4cbd-8575-b84500b37ef7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.769902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9aa69766-f825-4cbd-8575-b84500b37ef7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.769971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9aa69766-f825-4cbd-8575-b84500b37ef7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.770726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9aa69766-f825-4cbd-8575-b84500b37ef7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.770726] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9aa69766-f825-4cbd-8575-b84500b37ef7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.835381] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.835381] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.835637] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.836714] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcd19903-6f1e-4297-afc9-9decdfe37903 with status ACTIVE [ 658.837412] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.837733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.837733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.837985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.838084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.838373] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.838486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.838538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.838721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.838981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.838981] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.839113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.839586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.839586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.839718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.839751] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcd19903-6f1e-4297-afc9-9decdfe37903 is going to be updated. [ 658.867762] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.869345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.869492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.869838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.871777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.872076] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcd19903-6f1e-4297-afc9-9decdfe37903" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.885595] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f in Status: SUCCESS [ 658.886678] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f deletion is rescheduled due to dependency. [ 658.886678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.990802] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.990802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.990802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.990802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.990802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.990802] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.990802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.990802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.990802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.990802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.990802] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00540613-7092-4498-a250-9bb6d721591a already deleted. [ 658.990802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.243862] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 659.243862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.243862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.244556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.244556] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.244556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.244790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.244790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.245229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.245229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.245229] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.275584] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9aa69766-f825-4cbd-8575-b84500b37ef7 [ 659.275584] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.275584] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.276498] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.277523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.279471] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.279731] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9aa69766-f825-4cbd-8575-b84500b37ef7 already deleted. [ 659.279871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9aa69766-f825-4cbd-8575-b84500b37ef7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.343896] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.496441] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.499229] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-692" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.501325] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-692" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.501824] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-692" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.502389] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.502609] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.502759] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.506704] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.506704] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.506704] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.506704] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.506704] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.506704] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.506704] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.507361] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.507518] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.535409] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.535409] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.535409] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.535409] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-692" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.535409] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-83ef2e6f-d8ab-46d6-861e-569b18f20da1 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.535409] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-83ef2e6f-d8ab-46d6-861e-569b18f20da1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.535409] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-83ef2e6f-d8ab-46d6-861e-569b18f20da1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.535711] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-83ef2e6f-d8ab-46d6-861e-569b18f20da1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.535793] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83ef2e6f-d8ab-46d6-861e-569b18f20da1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.749552] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.751041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.751041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.751041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.751041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.751041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.751041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.751041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.751041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.751041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.751041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.751041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.751041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.751485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.751485] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.751550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.751550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.752344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.752344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.752344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.752344] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.845475] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.845645] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.845950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.846194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.846289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.846394] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57178755-8937-4ec8-907c-6e349b3947d2 is going to be created. [ 659.873987] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.874297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.874297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.874496] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.874762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.886342] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: UNINITIALIZED for 2s [ 660.038072] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.038505] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.038691] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.039026] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.039234] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.039438] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 83ef2e6f-d8ab-46d6-861e-569b18f20da1 not found, creating... [ 660.039765] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.039970] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.040329] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.042081] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.042285] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.042670] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.043020] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.043259] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.043782] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.043929] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.044100] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 83ef2e6f-d8ab-46d6-861e-569b18f20da1 is going to be created. [ 660.073884] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.074139] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.074230] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.074585] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.074831] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.075312] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-83ef2e6f-d8ab-46d6-861e-569b18f20da1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.254890] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9028d23d-9b03-48da-a060-d720486e9412: rpc.has_security_group_logging(os_id): False [ 660.284130] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.284582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.284881] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.285625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.285794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.286171] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.286380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.286525] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.286775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.286930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.288041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.288041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.288041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.288219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.288581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.288651] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.288806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.288935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.289446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.289446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.291174] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be created. [ 660.404291] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.404291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.404291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.404291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.404291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.422924] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 660.444729] env[69491]: INFO networking_nsxv3.common.synchronization [req-87802c0c-d710-457e-8806-fa2040585da2 req-4364b053-75d2-49fb-8e11-88e246d6a5fe tempest-ServerAddressesNegativeTestJSON-353182195 tempest-ServerAddressesNegativeTestJSON-353182195-project-member] Enqueued Resource ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 with Priority: HIGHEST for action security_group_members [ 660.446174] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 with Priority: HIGHEST for action security_group_members [ 660.446650] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc273f1-5898-4eda-a720-1bca483a33b9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.447422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.447521] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.447847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.448093] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.448577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.448577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.448650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.449753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.449753] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fc273f1-5898-4eda-a720-1bca483a33b9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.953717] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.953920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.953987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.954421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.954575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.954893] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.955141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.955141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.955321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.955407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.955490] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 already deleted. [ 660.955599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.159588] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.159798] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.159886] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.160264] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.160641] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.160758] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.160794] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.163901] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.164222] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.164530] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.164620] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.164726] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.164837] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.165226] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.165226] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.165226] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.209815] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.210037] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 661.210293] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.210536] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.211527] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-cc4b8c88-9158-4663-853d-3a9446b5d570 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.214022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-cc4b8c88-9158-4663-853d-3a9446b5d570" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.214022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-cc4b8c88-9158-4663-853d-3a9446b5d570" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.214022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-cc4b8c88-9158-4663-853d-3a9446b5d570" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.214022] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc4b8c88-9158-4663-853d-3a9446b5d570',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.717179] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.717179] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.717611] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.717918] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.717918] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.718135] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port cc4b8c88-9158-4663-853d-3a9446b5d570 not found, creating... [ 661.718971] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.718971] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.718971] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.719225] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.719393] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.719798] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.720015] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.720195] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.720476] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.720679] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.720881] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: cc4b8c88-9158-4663-853d-3a9446b5d570 is going to be created. [ 661.748031] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.748031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.748316] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.748451] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.749121] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.749121] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-cc4b8c88-9158-4663-853d-3a9446b5d570" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.896061] env[69491]: INFO networking_nsxv3.common.synchronization [req-b3e1c4fd-e97b-4771-9fc7-d15b87c23183 req-0fe06de7-4749-407a-a5ed-25853e73fb44 service nova] Enqueued Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGHEST for action security_group_rules [ 661.896313] env[69491]: INFO networking_nsxv3.common.synchronization [req-b3e1c4fd-e97b-4771-9fc7-d15b87c23183 req-0fe06de7-4749-407a-a5ed-25853e73fb44 service nova] Enqueued Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGHEST for action security_group_members [ 661.896445] env[69491]: INFO networking_nsxv3.common.synchronization [req-b3e1c4fd-e97b-4771-9fc7-d15b87c23183 req-0fe06de7-4749-407a-a5ed-25853e73fb44 service nova] Enqueued Resource ID: 83ef2e6f-d8ab-46d6-861e-569b18f20da1 with Priority: HIGHEST for action port [ 661.897152] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGHEST for action security_group_rules [ 661.897318] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGHEST for action security_group_members [ 661.897415] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83ef2e6f-d8ab-46d6-861e-569b18f20da1 with Priority: HIGHEST for action port [ 661.898172] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00540613-7092-4498-a250-9bb6d721591a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.898311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.898376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.898616] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.898699] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00540613-7092-4498-a250-9bb6d721591a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.901284] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-00540613-7092-4498-a250-9bb6d721591a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.901284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.901386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.902037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.902037] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.902037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.902037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.902037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.902914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.902914] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00540613-7092-4498-a250-9bb6d721591a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.903602] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-83ef2e6f-d8ab-46d6-861e-569b18f20da1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.903733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83ef2e6f-d8ab-46d6-861e-569b18f20da1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.903819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83ef2e6f-d8ab-46d6-861e-569b18f20da1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.903954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83ef2e6f-d8ab-46d6-861e-569b18f20da1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.905034] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83ef2e6f-d8ab-46d6-861e-569b18f20da1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.907174] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: SUCCESS [ 661.907422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.907547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.907760] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.907945] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.908151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.908151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.908363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.908420] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.908468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.908595] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.035710] env[69491]: INFO networking_nsxv3.common.synchronization [None req-b2f07ef8-172f-4bc2-893a-bade36536268 None None] Enqueued Resource ID: da07061a-6be1-42b9-b221-71a4f9c4ee42 with Priority: HIGHEST for action port [ 662.036433] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da07061a-6be1-42b9-b221-71a4f9c4ee42 with Priority: HIGHEST for action port [ 662.036667] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-da07061a-6be1-42b9-b221-71a4f9c4ee42 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.037847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da07061a-6be1-42b9-b221-71a4f9c4ee42" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.037847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da07061a-6be1-42b9-b221-71a4f9c4ee42" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.037943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da07061a-6be1-42b9-b221-71a4f9c4ee42" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.037975] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da07061a-6be1-42b9-b221-71a4f9c4ee42',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.247470] env[69491]: INFO networking_nsxv3.common.synchronization [None req-6208016f-d5b6-4ace-a11f-fe5c8bde5153 None None] Enqueued Resource ID: d39bd05c-3633-4892-9c79-1646048073f0 with Priority: HIGHEST for action port [ 662.247984] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d39bd05c-3633-4892-9c79-1646048073f0 with Priority: HIGHEST for action port [ 662.248649] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d39bd05c-3633-4892-9c79-1646048073f0 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.249251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d39bd05c-3633-4892-9c79-1646048073f0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.249517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d39bd05c-3633-4892-9c79-1646048073f0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.249854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d39bd05c-3633-4892-9c79-1646048073f0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.249989] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d39bd05c-3633-4892-9c79-1646048073f0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.406881] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-00540613-7092-4498-a250-9bb6d721591a taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.407155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.407155] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00540613-7092-4498-a250-9bb6d721591a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.410123] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83ef2e6f-d8ab-46d6-861e-569b18f20da1 with status ACTIVE [ 662.410123] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.410123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.410123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.410123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.410501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.410501] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.410615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.410615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.410765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.410853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.411082] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.411188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.411257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.411407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.411495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.411791] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83ef2e6f-d8ab-46d6-861e-569b18f20da1 is going to be updated. [ 662.416640] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.416858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.416858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.417171] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.417239] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.417391] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.417489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.417638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.417758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.417917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.418016] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.418157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.418263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.418316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.418500] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.418624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.418748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.418809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.418959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.418959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.419077] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.436305] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 662.437784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.442637] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.442849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.442849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.443173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.443333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.443488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83ef2e6f-d8ab-46d6-861e-569b18f20da1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.541571] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da07061a-6be1-42b9-b221-71a4f9c4ee42 [ 662.541571] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.541571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.541571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.541571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.542622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.542622] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da07061a-6be1-42b9-b221-71a4f9c4ee42 already deleted. [ 662.542622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da07061a-6be1-42b9-b221-71a4f9c4ee42" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.549806] env[69491]: INFO networking_nsxv3.common.synchronization [None req-597b649e-d491-4d6c-b27f-14493e7390f2 tempest-ServersV294TestFqdnHostnames-1976375908 tempest-ServersV294TestFqdnHostnames-1976375908-project-member] Enqueued Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGHEST for action security_group_rules [ 662.550806] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGHEST for action security_group_rules [ 662.551131] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0454f817-e35d-4717-870f-6288650eae31 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.551265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.551336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.552147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.552521] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0454f817-e35d-4717-870f-6288650eae31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.753710] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d39bd05c-3633-4892-9c79-1646048073f0 [ 662.753710] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.753710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.753710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.753710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.753710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.753710] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d39bd05c-3633-4892-9c79-1646048073f0 already deleted. [ 662.753710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d39bd05c-3633-4892-9c79-1646048073f0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.776395] env[69491]: INFO networking_nsxv3.common.synchronization [None req-1f73d3fd-675f-481f-9c6e-c59e828851c7 tempest-ServersV294TestFqdnHostnames-1976375908 tempest-ServersV294TestFqdnHostnames-1976375908-project-member] Enqueued Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGHEST for action security_group_rules [ 662.781325] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGHEST for action security_group_rules [ 662.783442] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0454f817-e35d-4717-870f-6288650eae31 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.783442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.911793] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00540613-7092-4498-a250-9bb6d721591a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.921410] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57178755-8937-4ec8-907c-6e349b3947d2: rpc.has_security_group_logging(os_id): False [ 662.945343] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.946037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.946037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.946037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.946037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.946226] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.946304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.946373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.946555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.946648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.946846] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.946942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.947381] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.947472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.947683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.947882] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.947960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.948011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.948142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.948219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.948341] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57178755-8937-4ec8-907c-6e349b3947d2 is going to be created. [ 663.020786] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.021060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.021060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.022746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.022746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.047672] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: IN_PROGRESS for 2s [ 663.075980] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.075980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.075980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.076302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.076302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.076463] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0454f817-e35d-4717-870f-6288650eae31 already deleted. [ 663.076527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.076645] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.076850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.076974] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0454f817-e35d-4717-870f-6288650eae31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.243297] env[69491]: INFO networking_nsxv3.common.synchronization [req-87802c0c-d710-457e-8806-fa2040585da2 req-6d74e470-1a39-444f-935e-b32093834b56 service nova] Enqueued Resource ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 with Priority: HIGHEST for action security_group_rules [ 663.243396] env[69491]: INFO networking_nsxv3.common.synchronization [req-87802c0c-d710-457e-8806-fa2040585da2 req-6d74e470-1a39-444f-935e-b32093834b56 service nova] Enqueued Resource ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 with Priority: HIGHEST for action security_group_members [ 663.243477] env[69491]: INFO networking_nsxv3.common.synchronization [req-87802c0c-d710-457e-8806-fa2040585da2 req-6d74e470-1a39-444f-935e-b32093834b56 service nova] Enqueued Resource ID: cc4b8c88-9158-4663-853d-3a9446b5d570 with Priority: HIGHEST for action port [ 663.244054] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 with Priority: HIGHEST for action security_group_rules [ 663.244402] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 with Priority: HIGHEST for action security_group_members [ 663.244485] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc4b8c88-9158-4663-853d-3a9446b5d570 with Priority: HIGHEST for action port [ 663.244966] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fc273f1-5898-4eda-a720-1bca483a33b9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.250020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.250020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.250020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.250020] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fc273f1-5898-4eda-a720-1bca483a33b9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.250020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc273f1-5898-4eda-a720-1bca483a33b9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.250020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.250020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.250020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.250020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.250020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.250020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.250020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.250020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.250020] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fc273f1-5898-4eda-a720-1bca483a33b9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.251319] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc4b8c88-9158-4663-853d-3a9446b5d570 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.251319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc4b8c88-9158-4663-853d-3a9446b5d570" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.251319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc4b8c88-9158-4663-853d-3a9446b5d570" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.251319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc4b8c88-9158-4663-853d-3a9446b5d570" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.251319] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc4b8c88-9158-4663-853d-3a9446b5d570',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.413211] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.414284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.414284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.414284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.414284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.414284] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00540613-7092-4498-a250-9bb6d721591a is going to be created. [ 663.443021] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.443021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.443021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.443021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.443021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.455347] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00540613-7092-4498-a250-9bb6d721591a in Status: UNINITIALIZED for 2s [ 663.489697] env[69491]: INFO networking_nsxv3.common.synchronization [None req-e9b60d3a-0b82-497e-b1ad-001a90bd7c4b None None] Enqueued Resource ID: 28228511-7800-463f-914b-e8854958c7f1 with Priority: HIGHEST for action port [ 663.490277] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28228511-7800-463f-914b-e8854958c7f1 with Priority: HIGHEST for action port [ 663.490614] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-28228511-7800-463f-914b-e8854958c7f1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.491017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28228511-7800-463f-914b-e8854958c7f1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.491123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28228511-7800-463f-914b-e8854958c7f1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.491419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28228511-7800-463f-914b-e8854958c7f1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.491514] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28228511-7800-463f-914b-e8854958c7f1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.613038] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.613191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.613346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.613469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.613652] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.613770] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0454f817-e35d-4717-870f-6288650eae31 already deleted. [ 663.613859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.756266] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fc273f1-5898-4eda-a720-1bca483a33b9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.756266] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc273f1-5898-4eda-a720-1bca483a33b9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.756266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.756266] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc4b8c88-9158-4663-853d-3a9446b5d570 with status ACTIVE [ 663.756266] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.756266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.756266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.756266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.756266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.756266] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.756266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.756266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.756266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.756266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.757268] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.763685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.763685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.763685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.763685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.763685] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc4b8c88-9158-4663-853d-3a9446b5d570 is going to be updated. [ 663.784240] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.784571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.784571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.784807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.784807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.785563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc4b8c88-9158-4663-853d-3a9446b5d570" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.943469] env[69491]: INFO networking_nsxv3.common.synchronization [req-940bc3cd-84fb-4d3b-8a04-a3aa77dd7d9a req-614e42d5-6b83-46e3-8b00-20291a2c5298 tempest-ServersTestJSON-1393834495 tempest-ServersTestJSON-1393834495-project-member] Enqueued Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGHEST for action security_group_members [ 663.944016] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGHEST for action security_group_members [ 663.944492] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70dddfb-485a-4313-8569-7ab012c8dc7e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.945934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.945934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.945934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.945934] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.945934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.946290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.946339] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.948394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.948394] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b70dddfb-485a-4313-8569-7ab012c8dc7e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.995297] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28228511-7800-463f-914b-e8854958c7f1 [ 663.995297] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.995297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.995297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.995511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.995511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.995732] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28228511-7800-463f-914b-e8854958c7f1 already deleted. [ 663.995732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28228511-7800-463f-914b-e8854958c7f1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.265915] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fc273f1-5898-4eda-a720-1bca483a33b9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.452202] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.452202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.452202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.452378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.452378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.452570] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.452665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.452726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.452839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.452910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.452993] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70dddfb-485a-4313-8569-7ab012c8dc7e already deleted. [ 664.453089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.769718] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.769718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.769718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.769718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.769718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.769718] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 is going to be created. [ 664.805300] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.805661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.805661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.805995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.808048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.823435] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 in Status: UNINITIALIZED for 2s [ 665.064197] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: SUCCESS [ 665.064540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.468757] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00540613-7092-4498-a250-9bb6d721591a in Status: SUCCESS [ 665.468757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.468757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.468757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.468757] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.468757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.468757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.468757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.468757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.468757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.468757] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00540613-7092-4498-a250-9bb6d721591a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.530184] env[69491]: INFO networking_nsxv3.common.synchronization [None req-79c8b9f5-f6ec-4639-abda-9f7be298edf3 None None] Enqueued Resource ID: a944abf3-e2d8-48b1-8abd-17f392f1ef2a with Priority: HIGHEST for action port [ 665.530184] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a944abf3-e2d8-48b1-8abd-17f392f1ef2a with Priority: HIGHEST for action port [ 665.530184] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-a944abf3-e2d8-48b1-8abd-17f392f1ef2a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.530184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a944abf3-e2d8-48b1-8abd-17f392f1ef2a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.530184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a944abf3-e2d8-48b1-8abd-17f392f1ef2a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.530184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a944abf3-e2d8-48b1-8abd-17f392f1ef2a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.530184] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a944abf3-e2d8-48b1-8abd-17f392f1ef2a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.665883] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-282 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.666139] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-282" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.666280] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-282" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.666630] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-282" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.667151] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.667374] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.667550] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.667783] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.667958] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.668364] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.668457] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.668558] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.668671] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.668794] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.668924] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.669356] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.697176] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.697702] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 665.697882] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.698127] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-282" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.698837] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-abc9c283-5ae5-42a6-84b0-3d581fe14b3d taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.700175] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-abc9c283-5ae5-42a6-84b0-3d581fe14b3d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.700418] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-abc9c283-5ae5-42a6-84b0-3d581fe14b3d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.700783] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-abc9c283-5ae5-42a6-84b0-3d581fe14b3d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.700937] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abc9c283-5ae5-42a6-84b0-3d581fe14b3d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.973400] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00540613-7092-4498-a250-9bb6d721591a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.034779] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a944abf3-e2d8-48b1-8abd-17f392f1ef2a [ 666.035079] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.035309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.035353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.036031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.036031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.036031] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a944abf3-e2d8-48b1-8abd-17f392f1ef2a already deleted. [ 666.036031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a944abf3-e2d8-48b1-8abd-17f392f1ef2a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.205954] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.206215] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.206512] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.206638] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.206812] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.207009] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port abc9c283-5ae5-42a6-84b0-3d581fe14b3d not found, creating... [ 666.207428] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.207606] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.207733] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.207988] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.209374] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.209723] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.209894] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.210027] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.210285] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.210432] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.210584] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: abc9c283-5ae5-42a6-84b0-3d581fe14b3d is going to be created. [ 666.236645] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.237392] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.237392] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.237645] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.237922] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.238347] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-abc9c283-5ae5-42a6-84b0-3d581fe14b3d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.256075] env[69491]: INFO networking_nsxv3.common.synchronization [req-a11d5da1-eaa5-4ac9-a3e3-53800cfb07bd req-0fd86b39-9ffe-4eec-a72c-2b94336daa96 tempest-ServersAdminNegativeTestJSON-1852575205 tempest-ServersAdminNegativeTestJSON-1852575205-project-member] Enqueued Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_members [ 666.256860] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_members [ 666.256949] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.257162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.257272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.257783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.259062] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.259062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.259062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.259062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.259062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.259317] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.476096] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00540613-7092-4498-a250-9bb6d721591a: rpc.has_security_group_logging(os_id): False [ 666.498774] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.498996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.499072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.499359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.499586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.499992] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.500132] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.500132] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.500282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.501421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.501421] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00540613-7092-4498-a250-9bb6d721591a is going to be created. [ 666.585042] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.585931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.585931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.585931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.585931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.600270] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00540613-7092-4498-a250-9bb6d721591a in Status: IN_PROGRESS for 2s [ 666.761537] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.761748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.761802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.762026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.762118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.762345] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.762451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.762514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.762671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.762746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.762828] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 already deleted. [ 666.762925] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.795632] env[69491]: INFO networking_nsxv3.common.synchronization [None req-652e57c7-179e-4afb-af52-457b2bbd6fb7 None None] Enqueued Resource ID: b272f7f4-c10b-4dff-9423-b41c6a8435bc with Priority: HIGHEST for action port [ 666.796189] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b272f7f4-c10b-4dff-9423-b41c6a8435bc with Priority: HIGHEST for action port [ 666.796711] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b272f7f4-c10b-4dff-9423-b41c6a8435bc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.796823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b272f7f4-c10b-4dff-9423-b41c6a8435bc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.796896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b272f7f4-c10b-4dff-9423-b41c6a8435bc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.797250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b272f7f4-c10b-4dff-9423-b41c6a8435bc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.797353] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b272f7f4-c10b-4dff-9423-b41c6a8435bc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.836876] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 in Status: SUCCESS [ 666.836876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.836876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.836876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.836876] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.836876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.836876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.836876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.836876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.836876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.836876] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fc273f1-5898-4eda-a720-1bca483a33b9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.301234] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b272f7f4-c10b-4dff-9423-b41c6a8435bc [ 667.301580] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.301927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.301927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.302067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.302184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.302330] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b272f7f4-c10b-4dff-9423-b41c6a8435bc already deleted. [ 667.302429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b272f7f4-c10b-4dff-9423-b41c6a8435bc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.344163] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc273f1-5898-4eda-a720-1bca483a33b9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.344367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.345305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.345305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.345305] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.345305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.345305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.345305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.345305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.345305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.345612] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc273f1-5898-4eda-a720-1bca483a33b9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.345612] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.345612] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.345788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.345889] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.345979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.346047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.346196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.346271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.346362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.346486] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fc273f1-5898-4eda-a720-1bca483a33b9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.363958] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.363958] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.363958] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.363958] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.364608] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.364608] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.364732] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.365505] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.365505] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.365743] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.365841] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.369759] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.370082] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.370292] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.370435] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.370700] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.397577] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.397577] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 667.397577] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.397577] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.397577] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-18a04ba6-ba2b-4e99-9e05-3a7e919d31a3 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.397577] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-18a04ba6-ba2b-4e99-9e05-3a7e919d31a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.397577] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-18a04ba6-ba2b-4e99-9e05-3a7e919d31a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.398472] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-18a04ba6-ba2b-4e99-9e05-3a7e919d31a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.398472] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18a04ba6-ba2b-4e99-9e05-3a7e919d31a3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.650949] env[69491]: INFO networking_nsxv3.common.synchronization [req-940bc3cd-84fb-4d3b-8a04-a3aa77dd7d9a req-bc9512b3-68fe-4aec-aabe-c54d305ef62c service nova] Enqueued Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGHEST for action security_group_rules [ 667.650949] env[69491]: INFO networking_nsxv3.common.synchronization [req-940bc3cd-84fb-4d3b-8a04-a3aa77dd7d9a req-bc9512b3-68fe-4aec-aabe-c54d305ef62c service nova] Enqueued Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGHEST for action security_group_members [ 667.650949] env[69491]: INFO networking_nsxv3.common.synchronization [req-940bc3cd-84fb-4d3b-8a04-a3aa77dd7d9a req-bc9512b3-68fe-4aec-aabe-c54d305ef62c service nova] Enqueued Resource ID: abc9c283-5ae5-42a6-84b0-3d581fe14b3d with Priority: HIGHEST for action port [ 667.652132] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGHEST for action security_group_rules [ 667.652406] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGHEST for action security_group_members [ 667.652889] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9c283-5ae5-42a6-84b0-3d581fe14b3d with Priority: HIGHEST for action port [ 667.653383] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b70dddfb-485a-4313-8569-7ab012c8dc7e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.653617] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.653759] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.654369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.654369] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b70dddfb-485a-4313-8569-7ab012c8dc7e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.655750] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70dddfb-485a-4313-8569-7ab012c8dc7e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.655982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.656168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.656560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.656975] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.657099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.657216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.657532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.657731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.657914] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b70dddfb-485a-4313-8569-7ab012c8dc7e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.659818] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-abc9c283-5ae5-42a6-84b0-3d581fe14b3d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.659818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abc9c283-5ae5-42a6-84b0-3d581fe14b3d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.659818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abc9c283-5ae5-42a6-84b0-3d581fe14b3d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.659818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abc9c283-5ae5-42a6-84b0-3d581fe14b3d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.660319] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abc9c283-5ae5-42a6-84b0-3d581fe14b3d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.850250] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fc273f1-5898-4eda-a720-1bca483a33b9: rpc.has_security_group_logging(os_id): False [ 667.873258] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.873402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.873472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.873694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.873780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.873963] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.874100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.874180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.874323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.874432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.874621] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.874715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.874774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.874940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.875039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.879621] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.879621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.879621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.879908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.879908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.880081] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 is going to be created. [ 667.903098] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.903098] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.903098] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.903390] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.904070] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.904070] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 18a04ba6-ba2b-4e99-9e05-3a7e919d31a3 not found, creating... [ 667.904070] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.904218] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.904257] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.904509] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.904678] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.904982] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.905662] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.905662] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.906081] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.906313] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.906482] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 18a04ba6-ba2b-4e99-9e05-3a7e919d31a3 is going to be created. [ 667.930336] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.930609] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.930674] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.930933] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.931180] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.931403] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-18a04ba6-ba2b-4e99-9e05-3a7e919d31a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.951163] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.951316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.951423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.951750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.952045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.970891] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 in Status: IN_PROGRESS for 2s [ 668.163263] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70dddfb-485a-4313-8569-7ab012c8dc7e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.163263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.163263] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b70dddfb-485a-4313-8569-7ab012c8dc7e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.163914] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abc9c283-5ae5-42a6-84b0-3d581fe14b3d with status ACTIVE [ 668.164155] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.164438] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.164513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.164731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.164823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.165029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.166581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.166655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.166853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.166943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.167281] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.167501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.167501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.167650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.167730] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.167822] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abc9c283-5ae5-42a6-84b0-3d581fe14b3d is going to be updated. [ 668.197220] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.197220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.197220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.197220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.197220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.197220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abc9c283-5ae5-42a6-84b0-3d581fe14b3d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.616782] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00540613-7092-4498-a250-9bb6d721591a in Status: SUCCESS [ 668.617178] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.670871] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b70dddfb-485a-4313-8569-7ab012c8dc7e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.707696] env[69491]: INFO networking_nsxv3.common.synchronization [req-1057bf22-4bda-4307-9abb-cd088b708f9f req-f556279c-fba8-472a-82cf-9e034bf304fe tempest-ServersWithSpecificFlavorTestJSON-938071933 tempest-ServersWithSpecificFlavorTestJSON-938071933-project-member] Enqueued Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_members [ 668.708281] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_members [ 668.709530] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.711018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.711018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.711018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.711018] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.711018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.711018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.711018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.711018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.711018] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.179464] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.179682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.179733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.179974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.180618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.180618] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70dddfb-485a-4313-8569-7ab012c8dc7e is going to be created. [ 669.214445] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.214629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.214629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.214824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.214980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.216319] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.216470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.216508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.216747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.216747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.216934] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.217038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.217107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.217396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.217472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.217557] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53902bde-30e4-44b3-9472-853fecdeacca already deleted. [ 669.217637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.228157] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70dddfb-485a-4313-8569-7ab012c8dc7e in Status: UNINITIALIZED for 2s [ 669.269612] env[69491]: INFO networking_nsxv3.common.synchronization [req-a11d5da1-eaa5-4ac9-a3e3-53800cfb07bd req-f7f14fee-d2d1-48f7-b093-590064d81075 service nova] Enqueued Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_rules [ 669.269810] env[69491]: INFO networking_nsxv3.common.synchronization [req-a11d5da1-eaa5-4ac9-a3e3-53800cfb07bd req-f7f14fee-d2d1-48f7-b093-590064d81075 service nova] Enqueued Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_members [ 669.269953] env[69491]: INFO networking_nsxv3.common.synchronization [req-a11d5da1-eaa5-4ac9-a3e3-53800cfb07bd req-f7f14fee-d2d1-48f7-b093-590064d81075 service nova] Enqueued Resource ID: 18a04ba6-ba2b-4e99-9e05-3a7e919d31a3 with Priority: HIGHEST for action port [ 669.270227] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_rules [ 669.270413] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_members [ 669.270562] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18a04ba6-ba2b-4e99-9e05-3a7e919d31a3 with Priority: HIGHEST for action port [ 669.271612] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.271752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.271809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.272222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.272222] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.272998] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.273142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.273212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.273419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.273568] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.273698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.273773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.273931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.274031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.274127] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.274910] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-18a04ba6-ba2b-4e99-9e05-3a7e919d31a3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.275142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18a04ba6-ba2b-4e99-9e05-3a7e919d31a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.275142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18a04ba6-ba2b-4e99-9e05-3a7e919d31a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.275315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18a04ba6-ba2b-4e99-9e05-3a7e919d31a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.275394] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18a04ba6-ba2b-4e99-9e05-3a7e919d31a3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.777737] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.779198] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.779388] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.779603] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18a04ba6-ba2b-4e99-9e05-3a7e919d31a3 with status ACTIVE [ 669.779904] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.780197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.780265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.780531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.781137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.781611] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.781843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.782024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.782559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.782559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.782955] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.783138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.783337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.783655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.784536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.784536] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18a04ba6-ba2b-4e99-9e05-3a7e919d31a3 is going to be updated. [ 669.792368] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.792368] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-896" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.792368] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-896" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.792368] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-896" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.792368] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.792368] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.792368] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.792368] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.792368] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.792368] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.792368] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.792368] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.792368] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.793100] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.793100] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.793100] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.819166] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.819166] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 669.819166] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.819411] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-896" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.819732] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-2bc70838-c7af-47d1-b3fc-f4612d922834 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.820342] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-2bc70838-c7af-47d1-b3fc-f4612d922834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.820342] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-2bc70838-c7af-47d1-b3fc-f4612d922834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.820648] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-2bc70838-c7af-47d1-b3fc-f4612d922834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.821292] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bc70838-c7af-47d1-b3fc-f4612d922834',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.825027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.825675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.825923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.826870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.826870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.827675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18a04ba6-ba2b-4e99-9e05-3a7e919d31a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.990495] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 in Status: SUCCESS [ 669.990698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.286713] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.325205] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.325833] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.325833] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.326024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.326119] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.326274] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 2bc70838-c7af-47d1-b3fc-f4612d922834 not found, creating... [ 670.326877] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.326877] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.326877] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.327175] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.327293] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.327714] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.329309] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.329309] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.329309] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.329309] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.329309] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 2bc70838-c7af-47d1-b3fc-f4612d922834 is going to be created. [ 670.356343] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.356502] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.356502] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.357514] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.357514] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.357514] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-2bc70838-c7af-47d1-b3fc-f4612d922834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.791692] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.792097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.792097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.792183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.792253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.792355] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 is going to be created. [ 670.832418] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.833097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.834018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.834018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.834018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.847987] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: UNINITIALIZED for 2s [ 671.241356] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70dddfb-485a-4313-8569-7ab012c8dc7e in Status: SUCCESS [ 671.241588] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.241896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.242170] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.245205] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.245205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.245205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.245205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.245205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.245205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.245205] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b70dddfb-485a-4313-8569-7ab012c8dc7e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.746216] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b70dddfb-485a-4313-8569-7ab012c8dc7e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.825846] env[69491]: INFO networking_nsxv3.common.synchronization [req-1057bf22-4bda-4307-9abb-cd088b708f9f req-e9bec3fb-b87a-494c-ac6d-bcee4d63eff2 service nova] Enqueued Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_rules [ 671.827864] env[69491]: INFO networking_nsxv3.common.synchronization [req-1057bf22-4bda-4307-9abb-cd088b708f9f req-e9bec3fb-b87a-494c-ac6d-bcee4d63eff2 service nova] Enqueued Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_members [ 671.828625] env[69491]: INFO networking_nsxv3.common.synchronization [req-1057bf22-4bda-4307-9abb-cd088b708f9f req-e9bec3fb-b87a-494c-ac6d-bcee4d63eff2 service nova] Enqueued Resource ID: 2bc70838-c7af-47d1-b3fc-f4612d922834 with Priority: HIGHEST for action port [ 671.829797] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_rules [ 671.830120] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_members [ 671.830293] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc70838-c7af-47d1-b3fc-f4612d922834 with Priority: HIGHEST for action port [ 671.831194] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.831421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.831488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.831789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.831981] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.834012] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.834012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.834012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.834306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.834574] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.835030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.835030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.835238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.835294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.835407] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.837104] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bc70838-c7af-47d1-b3fc-f4612d922834 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.837104] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bc70838-c7af-47d1-b3fc-f4612d922834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.837352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bc70838-c7af-47d1-b3fc-f4612d922834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.837541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bc70838-c7af-47d1-b3fc-f4612d922834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.837664] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bc70838-c7af-47d1-b3fc-f4612d922834',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.248413] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b70dddfb-485a-4313-8569-7ab012c8dc7e: rpc.has_security_group_logging(os_id): False [ 672.271095] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.271310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.271453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.271864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.272018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.272352] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.272514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.272585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.272783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.272870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.272962] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b70dddfb-485a-4313-8569-7ab012c8dc7e is going to be created. [ 672.342032] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bc70838-c7af-47d1-b3fc-f4612d922834 with status ACTIVE [ 672.342032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.342032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.342032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.342032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.342032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.342032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.342032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.342032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.342032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.342032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.342032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.342032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.342032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.342032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.342032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.342032] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bc70838-c7af-47d1-b3fc-f4612d922834 is going to be updated. [ 672.344142] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.344359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.344526] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.346758] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.346905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.346949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.350090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.350285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.365753] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b70dddfb-485a-4313-8569-7ab012c8dc7e in Status: IN_PROGRESS for 2s [ 672.371400] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.371567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.371626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.371989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.371989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.372157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bc70838-c7af-47d1-b3fc-f4612d922834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.454502] env[69491]: INFO networking_nsxv3.common.synchronization [req-743af435-ed7e-4c80-a054-e723092081a1 req-c573e3a8-1f10-4ca1-af54-5d0e20bfb958 tempest-TenantUsagesTestJSON-1735080768 tempest-TenantUsagesTestJSON-1735080768-project-member] Enqueued Resource ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 with Priority: HIGHEST for action security_group_members [ 672.455367] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 with Priority: HIGHEST for action security_group_members [ 672.455841] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-36f74a30-d3ec-48c5-8573-1f7852cad1f9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.456242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.456466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.456954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.457355] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.457732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.460274] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.460274] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.460274] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.460274] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36f74a30-d3ec-48c5-8573-1f7852cad1f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.854944] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.861546] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: SUCCESS [ 672.861843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.862088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.862157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.862926] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.862926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.862926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.862926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.862926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.862926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.863326] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.918853] env[69491]: INFO networking_nsxv3.common.synchronization [req-0a049941-dc68-4bd5-bf85-0b8788afe9dd req-0dba6231-608f-4796-b905-cacdd7c4f7cb tempest-ServerDiskConfigTestJSON-964931906 tempest-ServerDiskConfigTestJSON-964931906-project-member] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 672.919386] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 672.919710] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.919835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.919902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.920308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.920573] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.920573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.920736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.920784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.920842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.920939] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.966354] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.966479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.966524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.967227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.967227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.967343] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.967419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.967454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.967623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.967700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.968258] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 is going to be updated. [ 673.001607] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.001789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.001868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.002155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.002397] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.016023] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 in Status: IN_PROGRESS for 2s [ 673.359799] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.359799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.359799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.359799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.359799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.359799] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53902bde-30e4-44b3-9472-853fecdeacca is going to be created. [ 673.366204] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.366599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.366817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.367155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.367563] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.367878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.368107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.368428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.368644] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.368850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.369140] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.369373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.369528] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.369849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.370110] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.370404] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.370557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.370876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.371242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.372716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.372716] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.383613] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.384019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.384019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.384019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.384294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.394631] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: UNINITIALIZED for 2s [ 673.424299] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.424545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.424545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.424892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.424892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.425554] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.425554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.425554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.425554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.425554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.425737] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 673.469388] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.469597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.469597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.469950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.470194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.480475] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 673.877567] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c5808a0-5aae-42f0-89ec-a7d1d00bc588: rpc.has_security_group_logging(os_id): False [ 673.901835] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.901835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.901835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.901835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.901835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.902310] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.902310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.902310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.902310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.902539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.902589] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.902655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.902721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.904827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.904827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.905955] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.906138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.906312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.906411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.906548] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.907017] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 is going to be created. [ 673.977545] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.977545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.977545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.977545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.977545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.993701] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: IN_PROGRESS for 2s [ 674.382054] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b70dddfb-485a-4313-8569-7ab012c8dc7e in Status: SUCCESS [ 674.382602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.028278] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 in Status: SUCCESS [ 675.029604] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 deletion is rescheduled due to dependency. [ 675.029604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.406826] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: SUCCESS [ 675.409898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.409898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.409898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.409898] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.409898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.409898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.409898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.409898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.409898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.409898] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.493211] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 675.493211] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff deletion is rescheduled due to dependency. [ 675.493211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.723189] env[69491]: INFO networking_nsxv3.common.synchronization [None req-18ce91be-a84b-4df0-8245-0c4628f882d9 None None] Enqueued Resource ID: 754679ce-016e-40b9-90e0-ba213d0d429a with Priority: HIGHEST for action port [ 675.723440] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 754679ce-016e-40b9-90e0-ba213d0d429a with Priority: HIGHEST for action port [ 675.724154] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-754679ce-016e-40b9-90e0-ba213d0d429a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.724272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-754679ce-016e-40b9-90e0-ba213d0d429a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.724338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-754679ce-016e-40b9-90e0-ba213d0d429a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.724648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-754679ce-016e-40b9-90e0-ba213d0d429a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.724648] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('754679ce-016e-40b9-90e0-ba213d0d429a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.914952] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.010107] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: SUCCESS [ 676.011053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.230116] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 754679ce-016e-40b9-90e0-ba213d0d429a [ 676.230116] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.230116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.230116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.230116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.230116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.230116] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:754679ce-016e-40b9-90e0-ba213d0d429a already deleted. [ 676.230116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-754679ce-016e-40b9-90e0-ba213d0d429a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.421567] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53902bde-30e4-44b3-9472-853fecdeacca: rpc.has_security_group_logging(os_id): False [ 676.444146] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.444324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.444379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.444602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.444696] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.444963] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.445109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.445173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.445334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.445416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.449845] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53902bde-30e4-44b3-9472-853fecdeacca is going to be created. [ 676.519409] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.519685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.519685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.519822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.520043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.535730] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: IN_PROGRESS for 2s [ 677.779194] env[69491]: INFO networking_nsxv3.common.synchronization [None req-39403925-5ee1-411c-942d-e9956227f814 None None] Enqueued Resource ID: eb3657de-b084-4cdd-a49b-a657a3c085fa with Priority: HIGHEST for action port [ 677.779194] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb3657de-b084-4cdd-a49b-a657a3c085fa with Priority: HIGHEST for action port [ 677.779194] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb3657de-b084-4cdd-a49b-a657a3c085fa taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.779194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb3657de-b084-4cdd-a49b-a657a3c085fa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.779194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb3657de-b084-4cdd-a49b-a657a3c085fa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.780841] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb3657de-b084-4cdd-a49b-a657a3c085fa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.780841] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb3657de-b084-4cdd-a49b-a657a3c085fa',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.285546] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb3657de-b084-4cdd-a49b-a657a3c085fa [ 678.286261] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.287265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.287265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.287265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.287265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.287265] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb3657de-b084-4cdd-a49b-a657a3c085fa already deleted. [ 678.287265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb3657de-b084-4cdd-a49b-a657a3c085fa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.425908] env[69491]: INFO networking_nsxv3.common.synchronization [None req-bda1c3e3-3d57-4efa-b262-cedf41d50450 tempest-ServersTestBootFromVolume-1969005607 tempest-ServersTestBootFromVolume-1969005607-project-member] Enqueued Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGHEST for action security_group_rules [ 678.427726] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGHEST for action security_group_rules [ 678.429957] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de4976ed-85d7-4836-b6cb-a96b2293c655 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.429957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.429957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.429957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.429957] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.550131] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: SUCCESS [ 678.550212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.692992] env[69491]: INFO networking_nsxv3.common.synchronization [None req-42b593bd-1547-408d-802d-e86b7186ad36 tempest-ServersTestBootFromVolume-1969005607 tempest-ServersTestBootFromVolume-1969005607-project-member] Enqueued Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGHEST for action security_group_rules [ 678.692992] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGHEST for action security_group_rules [ 678.692992] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de4976ed-85d7-4836-b6cb-a96b2293c655 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.692992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.950853] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.951331] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.951331] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.951437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.951637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.951637] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de4976ed-85d7-4836-b6cb-a96b2293c655 already deleted. [ 678.951831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.951934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.952182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.952354] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.395271] env[69491]: INFO networking_nsxv3.common.synchronization [None req-49506565-db28-4f46-904d-71d62bdd1b65 None None] Enqueued Resource ID: f87da813-7c99-47ce-a9be-3817cd0ec756 with Priority: HIGHEST for action port [ 679.395775] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f87da813-7c99-47ce-a9be-3817cd0ec756 with Priority: HIGHEST for action port [ 679.396164] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f87da813-7c99-47ce-a9be-3817cd0ec756 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.396291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f87da813-7c99-47ce-a9be-3817cd0ec756" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.396357] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f87da813-7c99-47ce-a9be-3817cd0ec756" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.397253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f87da813-7c99-47ce-a9be-3817cd0ec756" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.397253] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f87da813-7c99-47ce-a9be-3817cd0ec756',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.477269] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.481172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.481336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.481965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.481965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.481965] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de4976ed-85d7-4836-b6cb-a96b2293c655 already deleted. [ 679.481965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.901736] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f87da813-7c99-47ce-a9be-3817cd0ec756 [ 679.901981] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.902207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.902207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.902433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.902575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.903104] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f87da813-7c99-47ce-a9be-3817cd0ec756 already deleted. [ 679.903228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f87da813-7c99-47ce-a9be-3817cd0ec756" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.523731] env[69491]: INFO networking_nsxv3.common.synchronization [req-ded36b36-265d-4302-be53-3ae77eb63a71 req-ac54815a-19d6-4423-b94b-520df11271ce tempest-ListServersNegativeTestJSON-1336340583 tempest-ListServersNegativeTestJSON-1336340583-project-member] Enqueued Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 680.524121] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 680.524896] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.526387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.526762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.527623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.527623] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.527623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.527623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.528570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.528716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.528777] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.031498] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.031751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.031833] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.032094] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.032226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.032453] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.032586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.032883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.032948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.033042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.033171] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 already deleted. [ 681.033275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.181037] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.181346] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.181484] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.181919] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.182293] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.182517] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.182640] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.183491] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.183748] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.184243] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.184243] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.184385] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.184715] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.184715] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.184715] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.184961] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.196387] env[69491]: INFO networking_nsxv3.common.synchronization [req-312bb932-9bcd-497e-9c03-78721e69590e req-132969c8-5f59-49ea-b56a-3cc1bc6e8f35 tempest-ServerAddressesNegativeTestJSON-353182195 tempest-ServerAddressesNegativeTestJSON-353182195-project-member] Enqueued Resource ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 with Priority: HIGHEST for action security_group_members [ 681.197468] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 with Priority: HIGHEST for action security_group_members [ 681.198543] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc273f1-5898-4eda-a720-1bca483a33b9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.198656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.198740] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.198913] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.199177] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.199289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.199379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.199614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.199717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.199821] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fc273f1-5898-4eda-a720-1bca483a33b9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.223087] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.223496] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 681.223676] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.223943] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.224418] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-fe2862a4-d855-448b-8be0-0fd6dfd7d2ba taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.224631] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-fe2862a4-d855-448b-8be0-0fd6dfd7d2ba" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.224794] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-fe2862a4-d855-448b-8be0-0fd6dfd7d2ba" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.225404] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-fe2862a4-d855-448b-8be0-0fd6dfd7d2ba" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.225603] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe2862a4-d855-448b-8be0-0fd6dfd7d2ba',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.702488] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.702798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.702798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.703029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.703124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.703332] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.703427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.703487] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.703664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.703750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.703841] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 is going to be updated. [ 681.730189] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.730843] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.732017] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.732017] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.732017] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.732162] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port fe2862a4-d855-448b-8be0-0fd6dfd7d2ba not found, creating... [ 681.732500] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.733643] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.733873] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.734221] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.735187] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.738022] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.738022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.738022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.738022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.738022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.738022] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: fe2862a4-d855-448b-8be0-0fd6dfd7d2ba is going to be created. [ 681.750015] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.750015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.750015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.750015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.750015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.756457] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 in Status: IN_PROGRESS for 2s [ 681.762926] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.763165] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.763290] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.763563] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.763788] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.764026] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-fe2862a4-d855-448b-8be0-0fd6dfd7d2ba" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.642964] env[69491]: INFO networking_nsxv3.common.synchronization [None req-74781fff-03a7-4a4a-a9f7-66a9225073f6 None None] Enqueued Resource ID: aaf6b6d5-c6d9-47fb-9259-0ae4a9c2339e with Priority: HIGHEST for action port [ 682.644440] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf6b6d5-c6d9-47fb-9259-0ae4a9c2339e with Priority: HIGHEST for action port [ 682.644850] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaf6b6d5-c6d9-47fb-9259-0ae4a9c2339e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.645044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaf6b6d5-c6d9-47fb-9259-0ae4a9c2339e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.645212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaf6b6d5-c6d9-47fb-9259-0ae4a9c2339e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.645957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaf6b6d5-c6d9-47fb-9259-0ae4a9c2339e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.646150] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaf6b6d5-c6d9-47fb-9259-0ae4a9c2339e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.716596] env[69491]: INFO networking_nsxv3.common.synchronization [req-d0a53962-79fa-46ce-b36e-6da5df2e7406 req-b21d56af-fa97-4899-a71f-07fbfc31a4d4 tempest-FloatingIPsAssociationNegativeTestJSON-434017054 tempest-FloatingIPsAssociationNegativeTestJSON-434017054-project-member] Enqueued Resource ID: 24376446-4b3c-421b-a079-0ca7bece8e3b with Priority: HIGHEST for action security_group_members [ 682.717142] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24376446-4b3c-421b-a079-0ca7bece8e3b with Priority: HIGHEST for action security_group_members [ 682.717543] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-24376446-4b3c-421b-a079-0ca7bece8e3b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.717673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.717735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.718031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.719838] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.719972] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.720060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.720252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.720341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.720436] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24376446-4b3c-421b-a079-0ca7bece8e3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.939791] env[69491]: INFO networking_nsxv3.common.synchronization [req-65ff8411-c006-49aa-b4ff-7183f1f962c5 req-36351e3f-67ce-44b3-a047-5bc342cf17ac tempest-SecurityGroupRulesTestJSON-1058747886 tempest-SecurityGroupRulesTestJSON-1058747886-project-member] Enqueued Resource ID: b864a0be-6aa9-41cb-8d22-04ad921ab4e6 with Priority: HIGHEST for action security_group_rules [ 682.940508] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b864a0be-6aa9-41cb-8d22-04ad921ab4e6 with Priority: HIGHEST for action security_group_rules [ 682.940825] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b864a0be-6aa9-41cb-8d22-04ad921ab4e6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.940951] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b864a0be-6aa9-41cb-8d22-04ad921ab4e6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.943809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b864a0be-6aa9-41cb-8d22-04ad921ab4e6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.943809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b864a0be-6aa9-41cb-8d22-04ad921ab4e6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.943809] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b864a0be-6aa9-41cb-8d22-04ad921ab4e6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.148592] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aaf6b6d5-c6d9-47fb-9259-0ae4a9c2339e [ 683.148978] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.148978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.149186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.149285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.149385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.149482] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aaf6b6d5-c6d9-47fb-9259-0ae4a9c2339e already deleted. [ 683.149576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaf6b6d5-c6d9-47fb-9259-0ae4a9c2339e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.225991] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.225991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.225991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.225991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.225991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.227042] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.227564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.230039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.230039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.230039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.230039] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24376446-4b3c-421b-a079-0ca7bece8e3b is going to be updated. [ 683.262147] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.262320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.262545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.262775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.262948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.275616] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24376446-4b3c-421b-a079-0ca7bece8e3b in Status: IN_PROGRESS for 2s [ 683.356246] env[69491]: INFO networking_nsxv3.common.synchronization [req-ded36b36-265d-4302-be53-3ae77eb63a71 req-f65a03b4-be2e-48e2-b13c-024237e49e20 service nova] Enqueued Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_rules [ 683.356446] env[69491]: INFO networking_nsxv3.common.synchronization [req-ded36b36-265d-4302-be53-3ae77eb63a71 req-f65a03b4-be2e-48e2-b13c-024237e49e20 service nova] Enqueued Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 683.356728] env[69491]: INFO networking_nsxv3.common.synchronization [req-ded36b36-265d-4302-be53-3ae77eb63a71 req-f65a03b4-be2e-48e2-b13c-024237e49e20 service nova] Enqueued Resource ID: fe2862a4-d855-448b-8be0-0fd6dfd7d2ba with Priority: HIGHEST for action port [ 683.357426] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_rules [ 683.357668] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 683.357897] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2862a4-d855-448b-8be0-0fd6dfd7d2ba with Priority: HIGHEST for action port [ 683.358406] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.358562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.358653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.358971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.359103] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.360757] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.361483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.361580] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.361825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.362277] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.362470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.362570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.362854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.363090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.363390] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.364051] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe2862a4-d855-448b-8be0-0fd6dfd7d2ba taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.364162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe2862a4-d855-448b-8be0-0fd6dfd7d2ba" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.364222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe2862a4-d855-448b-8be0-0fd6dfd7d2ba" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.364374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe2862a4-d855-448b-8be0-0fd6dfd7d2ba" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.364443] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe2862a4-d855-448b-8be0-0fd6dfd7d2ba',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.468379] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.468607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.468674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.468877] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.468971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.469122] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b864a0be-6aa9-41cb-8d22-04ad921ab4e6 already deleted. [ 683.469234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b864a0be-6aa9-41cb-8d22-04ad921ab4e6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.767474] env[69491]: INFO networking_nsxv3.common.synchronization [req-ded36b36-265d-4302-be53-3ae77eb63a71 req-b3ae77b3-5afd-4ad6-a3b6-6c1182d37ce6 tempest-ListServersNegativeTestJSON-1336340583 tempest-ListServersNegativeTestJSON-1336340583-project-member] Enqueued Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 683.768956] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 in Status: SUCCESS [ 683.770391] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 deletion is rescheduled due to dependency. [ 683.770391] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.770391] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 683.770391] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.770391] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.861480] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.861480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.869033] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.870195] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe2862a4-d855-448b-8be0-0fd6dfd7d2ba with status ACTIVE [ 683.871566] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.871566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.871566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.871566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.871566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.871566] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.871566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.871566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.871566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.871566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.871963] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.871963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.871963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.872093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.872347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.872347] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe2862a4-d855-448b-8be0-0fd6dfd7d2ba is going to be updated. [ 683.903706] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.903904] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.903952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.904175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.904824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.904824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe2862a4-d855-448b-8be0-0fd6dfd7d2ba" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.285836] env[69491]: INFO networking_nsxv3.common.synchronization [None req-c253c3d3-22c7-4be8-88ad-acae201bfecb None None] Enqueued Resource ID: 9b0123a3-64fc-4cc5-8256-e31f21047d8e with Priority: HIGHEST for action port [ 684.286459] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b0123a3-64fc-4cc5-8256-e31f21047d8e with Priority: HIGHEST for action port [ 684.286847] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b0123a3-64fc-4cc5-8256-e31f21047d8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.287048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b0123a3-64fc-4cc5-8256-e31f21047d8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.287134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b0123a3-64fc-4cc5-8256-e31f21047d8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.287792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b0123a3-64fc-4cc5-8256-e31f21047d8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.287909] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b0123a3-64fc-4cc5-8256-e31f21047d8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.376387] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.799534] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b0123a3-64fc-4cc5-8256-e31f21047d8e [ 684.799534] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.799534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.799534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.799534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.799534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.799534] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b0123a3-64fc-4cc5-8256-e31f21047d8e already deleted. [ 684.799534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b0123a3-64fc-4cc5-8256-e31f21047d8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.882041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.882888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.882888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.882888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.882888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.882888] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 is going to be created. [ 684.918346] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.918657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.918657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.918851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.919410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.934065] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: UNINITIALIZED for 2s [ 685.288870] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24376446-4b3c-421b-a079-0ca7bece8e3b in Status: SUCCESS [ 685.288870] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24376446-4b3c-421b-a079-0ca7bece8e3b deletion is rescheduled due to dependency. [ 685.288870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.709355] env[69491]: INFO networking_nsxv3.common.synchronization [None req-ddd73ea2-4d9d-4086-b94e-4499115aedc8 None None] Enqueued Resource ID: b1507d4d-a465-4ef4-a333-0a2192bcd25d with Priority: HIGHEST for action port [ 685.709355] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1507d4d-a465-4ef4-a333-0a2192bcd25d with Priority: HIGHEST for action port [ 685.709911] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1507d4d-a465-4ef4-a333-0a2192bcd25d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.709911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1507d4d-a465-4ef4-a333-0a2192bcd25d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.710068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1507d4d-a465-4ef4-a333-0a2192bcd25d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.711370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1507d4d-a465-4ef4-a333-0a2192bcd25d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.711598] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1507d4d-a465-4ef4-a333-0a2192bcd25d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.788866] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.789403] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.789403] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.789954] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.791227] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.794369] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.794369] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.794369] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.794369] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.794369] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.794369] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.794369] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.794369] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.794369] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.794369] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.794369] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.818468] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.818468] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 685.818844] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.822808] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.822808] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-1ec65f13-2996-4b6a-af0a-26a6212f8008 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.823050] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-1ec65f13-2996-4b6a-af0a-26a6212f8008" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.823050] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-1ec65f13-2996-4b6a-af0a-26a6212f8008" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.823810] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-1ec65f13-2996-4b6a-af0a-26a6212f8008" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.823810] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ec65f13-2996-4b6a-af0a-26a6212f8008',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.214530] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1507d4d-a465-4ef4-a333-0a2192bcd25d [ 686.214903] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.215144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.215280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.215543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.215711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.215884] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1507d4d-a465-4ef4-a333-0a2192bcd25d already deleted. [ 686.216066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1507d4d-a465-4ef4-a333-0a2192bcd25d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.220410] env[69491]: INFO networking_nsxv3.common.synchronization [req-55686f07-9739-438d-ac94-65684e0cde8d req-a2a58c10-7a79-44b3-8243-99d0266fe9c0 tempest-SecurityGroupRulesTestJSON-1058747886 tempest-SecurityGroupRulesTestJSON-1058747886-project-member] Enqueued Resource ID: 48d990a0-e142-4f31-905a-477e48dea64b with Priority: HIGHEST for action security_group_rules [ 686.221048] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d990a0-e142-4f31-905a-477e48dea64b with Priority: HIGHEST for action security_group_rules [ 686.221401] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d990a0-e142-4f31-905a-477e48dea64b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.221533] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d990a0-e142-4f31-905a-477e48dea64b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.221609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d990a0-e142-4f31-905a-477e48dea64b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.222937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d990a0-e142-4f31-905a-477e48dea64b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.226022] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d990a0-e142-4f31-905a-477e48dea64b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.326754] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.328479] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.328765] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.329204] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.329486] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.329845] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 1ec65f13-2996-4b6a-af0a-26a6212f8008 not found, creating... [ 686.331027] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.331027] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.331027] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.331027] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.332275] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.336298] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.336298] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.336298] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.336298] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.336298] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.336298] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 1ec65f13-2996-4b6a-af0a-26a6212f8008 is going to be created. [ 686.362985] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.363634] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.363634] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.364615] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.364615] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.364615] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-1ec65f13-2996-4b6a-af0a-26a6212f8008" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.746460] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.746644] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.746691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.749882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.749882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.749882] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d990a0-e142-4f31-905a-477e48dea64b already deleted. [ 686.749882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d990a0-e142-4f31-905a-477e48dea64b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.944982] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: SUCCESS [ 686.945262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.947363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.947363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.947363] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.947363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.947363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.947363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.947363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.947363] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.452149] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.509382] env[69491]: INFO networking_nsxv3.common.synchronization [None req-9014e700-a949-44cd-b81a-261cee57e3c9 None None] Enqueued Resource ID: cefaa11a-e487-41a6-bc34-c0c2bb6d4015 with Priority: HIGHEST for action port [ 687.509656] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cefaa11a-e487-41a6-bc34-c0c2bb6d4015 with Priority: HIGHEST for action port [ 687.510265] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-cefaa11a-e487-41a6-bc34-c0c2bb6d4015 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.510519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cefaa11a-e487-41a6-bc34-c0c2bb6d4015" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.510519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cefaa11a-e487-41a6-bc34-c0c2bb6d4015" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.510721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cefaa11a-e487-41a6-bc34-c0c2bb6d4015" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.513022] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cefaa11a-e487-41a6-bc34-c0c2bb6d4015',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.533838] env[69491]: INFO networking_nsxv3.common.synchronization [req-ded36b36-265d-4302-be53-3ae77eb63a71 req-ad7a4a54-cc60-46be-b2dd-68c846db8dbd tempest-ListServersNegativeTestJSON-1336340583 tempest-ListServersNegativeTestJSON-1336340583-project-member] Enqueued Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 687.534410] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 687.534682] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.534782] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.952755] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.014959] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cefaa11a-e487-41a6-bc34-c0c2bb6d4015 [ 688.014959] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.014959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.014959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.014959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.014959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.014959] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cefaa11a-e487-41a6-bc34-c0c2bb6d4015 already deleted. [ 688.014959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cefaa11a-e487-41a6-bc34-c0c2bb6d4015" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.335764] env[69491]: INFO networking_nsxv3.common.synchronization [req-ded36b36-265d-4302-be53-3ae77eb63a71 req-8e694bb1-5f99-4b6d-b1fe-c01c4739a677 service nova] Enqueued Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_rules [ 688.335764] env[69491]: INFO networking_nsxv3.common.synchronization [req-ded36b36-265d-4302-be53-3ae77eb63a71 req-8e694bb1-5f99-4b6d-b1fe-c01c4739a677 service nova] Enqueued Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 688.335764] env[69491]: INFO networking_nsxv3.common.synchronization [req-ded36b36-265d-4302-be53-3ae77eb63a71 req-8e694bb1-5f99-4b6d-b1fe-c01c4739a677 service nova] Enqueued Resource ID: 1ec65f13-2996-4b6a-af0a-26a6212f8008 with Priority: HIGHEST for action port [ 688.336578] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_rules [ 688.336746] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 688.336822] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ec65f13-2996-4b6a-af0a-26a6212f8008 with Priority: HIGHEST for action port [ 688.337183] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.337268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.337851] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.337851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.337851] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ec65f13-2996-4b6a-af0a-26a6212f8008 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.337851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ec65f13-2996-4b6a-af0a-26a6212f8008" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.338211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ec65f13-2996-4b6a-af0a-26a6212f8008" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.338211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ec65f13-2996-4b6a-af0a-26a6212f8008" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.338272] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ec65f13-2996-4b6a-af0a-26a6212f8008',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.456874] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.457057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.458031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.458120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.458206] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.458319] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 is going to be updated. [ 688.495327] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.495490] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.495567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.495831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.495941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.510041] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: IN_PROGRESS for 2s [ 688.840252] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ec65f13-2996-4b6a-af0a-26a6212f8008 with status ACTIVE [ 688.840673] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.840824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.840824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.841047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.841137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.841351] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.841456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.841520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.841678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.841754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.841983] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.842150] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.842232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.842401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.842562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.842625] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ec65f13-2996-4b6a-af0a-26a6212f8008 is going to be updated. [ 688.859992] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.860237] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.860364] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.862022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.862022] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.862223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.862386] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.862683] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.862839] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.863160] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.863340] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.863484] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.863594] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.863725] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.863834] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.863971] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.873863] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.874124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.874124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.874344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.874651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.874651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ec65f13-2996-4b6a-af0a-26a6212f8008" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.890155] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.890357] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 688.890495] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.890689] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.891809] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-117cbe7d-ed81-4667-951f-7cdbd1f1af5e taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.891809] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-117cbe7d-ed81-4667-951f-7cdbd1f1af5e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.891809] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-117cbe7d-ed81-4667-951f-7cdbd1f1af5e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.891809] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-117cbe7d-ed81-4667-951f-7cdbd1f1af5e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.891809] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('117cbe7d-ed81-4667-951f-7cdbd1f1af5e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.253577] env[69491]: INFO networking_nsxv3.common.synchronization [None req-bf5f0113-9d38-4058-aa9b-3e6c8c4fa77c None None] Enqueued Resource ID: 01cff1cb-99f1-4f26-ab70-addf1f8d8937 with Priority: HIGHEST for action port [ 689.254726] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01cff1cb-99f1-4f26-ab70-addf1f8d8937 with Priority: HIGHEST for action port [ 689.256104] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-01cff1cb-99f1-4f26-ab70-addf1f8d8937 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.256388] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01cff1cb-99f1-4f26-ab70-addf1f8d8937" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.256784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01cff1cb-99f1-4f26-ab70-addf1f8d8937" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.256885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01cff1cb-99f1-4f26-ab70-addf1f8d8937" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.257854] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01cff1cb-99f1-4f26-ab70-addf1f8d8937',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.399112] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.399112] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.399112] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.399112] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.399364] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.399425] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 117cbe7d-ed81-4667-951f-7cdbd1f1af5e not found, creating... [ 689.400226] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.400226] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.400226] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.400519] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.401188] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.401732] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.402278] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.402471] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.402784] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.402951] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.403223] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 117cbe7d-ed81-4667-951f-7cdbd1f1af5e is going to be created. [ 689.433041] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.433041] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.433041] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.433041] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.433041] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.433041] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-117cbe7d-ed81-4667-951f-7cdbd1f1af5e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.760961] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01cff1cb-99f1-4f26-ab70-addf1f8d8937 [ 689.761275] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.761511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.761511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.761878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.761878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.762032] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01cff1cb-99f1-4f26-ab70-addf1f8d8937 already deleted. [ 689.762084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01cff1cb-99f1-4f26-ab70-addf1f8d8937" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.451649] env[69491]: INFO networking_nsxv3.common.synchronization [None req-aaf85151-9068-4303-8cea-c1de49e4e23f None None] Enqueued Resource ID: 5c96ea81-1976-49a3-a4f0-8471e3833b91 with Priority: HIGHEST for action port [ 690.452019] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c96ea81-1976-49a3-a4f0-8471e3833b91 with Priority: HIGHEST for action port [ 690.453037] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c96ea81-1976-49a3-a4f0-8471e3833b91 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.453037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c96ea81-1976-49a3-a4f0-8471e3833b91" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.453304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c96ea81-1976-49a3-a4f0-8471e3833b91" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.453720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c96ea81-1976-49a3-a4f0-8471e3833b91" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.453850] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c96ea81-1976-49a3-a4f0-8471e3833b91',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.523345] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: SUCCESS [ 690.523801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.524029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.524310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.525176] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.527022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.527022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.527022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.527022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.527022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.527022] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.529341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.529341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.529341] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.529341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.529341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.529815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.529815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.529815] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.531256] env[69491]: INFO networking_nsxv3.common.synchronization [req-ded36b36-265d-4302-be53-3ae77eb63a71 req-d2f0eed0-9f52-43ab-ae22-91e841718e5b service nova] Enqueued Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_rules [ 690.531420] env[69491]: INFO networking_nsxv3.common.synchronization [req-ded36b36-265d-4302-be53-3ae77eb63a71 req-d2f0eed0-9f52-43ab-ae22-91e841718e5b service nova] Enqueued Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 690.531759] env[69491]: INFO networking_nsxv3.common.synchronization [req-ded36b36-265d-4302-be53-3ae77eb63a71 req-d2f0eed0-9f52-43ab-ae22-91e841718e5b service nova] Enqueued Resource ID: 117cbe7d-ed81-4667-951f-7cdbd1f1af5e with Priority: HIGHEST for action port [ 690.532742] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_rules [ 690.532901] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 690.533991] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 117cbe7d-ed81-4667-951f-7cdbd1f1af5e with Priority: HIGHEST for action port [ 690.534437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.534437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.534660] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.534829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.535115] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-117cbe7d-ed81-4667-951f-7cdbd1f1af5e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.535247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-117cbe7d-ed81-4667-951f-7cdbd1f1af5e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.535287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-117cbe7d-ed81-4667-951f-7cdbd1f1af5e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.535498] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-117cbe7d-ed81-4667-951f-7cdbd1f1af5e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.535569] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('117cbe7d-ed81-4667-951f-7cdbd1f1af5e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.937839] env[69491]: INFO networking_nsxv3.common.synchronization [None req-65f59147-f268-424f-a547-00a8a39c561b None None] Enqueued Resource ID: 9de43f58-6419-4da0-8d54-2ded671c9050 with Priority: HIGHEST for action port [ 690.937839] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de43f58-6419-4da0-8d54-2ded671c9050 with Priority: HIGHEST for action port [ 690.937839] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-9de43f58-6419-4da0-8d54-2ded671c9050 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.937839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9de43f58-6419-4da0-8d54-2ded671c9050" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.937839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9de43f58-6419-4da0-8d54-2ded671c9050" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.938567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9de43f58-6419-4da0-8d54-2ded671c9050" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.938748] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9de43f58-6419-4da0-8d54-2ded671c9050',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.957102] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c96ea81-1976-49a3-a4f0-8471e3833b91 [ 690.957288] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.957567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.957688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.957846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.957961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.958127] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c96ea81-1976-49a3-a4f0-8471e3833b91 already deleted. [ 690.958228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c96ea81-1976-49a3-a4f0-8471e3833b91" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.034746] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.036142] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.036264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.038496] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 117cbe7d-ed81-4667-951f-7cdbd1f1af5e with status ACTIVE [ 691.038605] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.038767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.038853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.039102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.039200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.039660] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.039660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.039660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.039895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.039895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.039992] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.040080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.040155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.040346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.040429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.040519] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 117cbe7d-ed81-4667-951f-7cdbd1f1af5e is going to be updated. [ 691.064050] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.064203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.064271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.064522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.064851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.064851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-117cbe7d-ed81-4667-951f-7cdbd1f1af5e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.349109] env[69491]: INFO networking_nsxv3.common.synchronization [req-2a6b3f1f-22d8-4498-9d95-0ceb2c400dd6 req-ebad86fb-1d22-4a38-a78b-dcde64ef6ef0 tempest-FloatingIPsAssociationTestJSON-1311896295 tempest-FloatingIPsAssociationTestJSON-1311896295-project-member] Enqueued Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_members [ 691.349109] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_members [ 691.349109] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.349109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.349109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.349109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.349109] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.349109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.349109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.349109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.349109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.349109] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.444252] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9de43f58-6419-4da0-8d54-2ded671c9050 [ 691.444252] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.444427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.444427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.444662] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.444976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.444976] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9de43f58-6419-4da0-8d54-2ded671c9050 already deleted. [ 691.444976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9de43f58-6419-4da0-8d54-2ded671c9050" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.539017] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.855027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.855027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.855027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.855027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.855027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.855027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.855027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.855027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.855027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.855027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.855027] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a already deleted. [ 691.855027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.041829] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.042029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.042103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.042331] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.042467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.042594] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 is going to be updated. [ 692.089177] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.089368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.089455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.089711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.089863] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.104651] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: IN_PROGRESS for 2s [ 692.174887] env[69491]: INFO networking_nsxv3.common.synchronization [None req-cdb61300-52ce-402f-941b-3e1641a5e496 None None] Enqueued Resource ID: bf8542cd-9a6b-452e-adf2-150b1441aba5 with Priority: HIGHEST for action port [ 692.175464] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf8542cd-9a6b-452e-adf2-150b1441aba5 with Priority: HIGHEST for action port [ 692.176859] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf8542cd-9a6b-452e-adf2-150b1441aba5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.177021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf8542cd-9a6b-452e-adf2-150b1441aba5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.177074] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf8542cd-9a6b-452e-adf2-150b1441aba5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.177327] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf8542cd-9a6b-452e-adf2-150b1441aba5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.177431] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf8542cd-9a6b-452e-adf2-150b1441aba5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.680344] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf8542cd-9a6b-452e-adf2-150b1441aba5 [ 692.680794] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.680973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.681064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.681325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.681429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.681559] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf8542cd-9a6b-452e-adf2-150b1441aba5 already deleted. [ 692.681650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf8542cd-9a6b-452e-adf2-150b1441aba5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.833865] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-72 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.834065] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-72" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.834241] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-72" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.834652] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-72" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.834954] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.835161] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.835285] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.835608] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.835762] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.835981] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.837515] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.837851] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.837926] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.838142] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.838291] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.838519] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.867735] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.867899] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 692.868120] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.868451] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-72" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.870172] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-5ea7b4af-4d3f-4224-b062-f94718d2db92 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.870172] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-5ea7b4af-4d3f-4224-b062-f94718d2db92" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.870172] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-5ea7b4af-4d3f-4224-b062-f94718d2db92" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.870498] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-5ea7b4af-4d3f-4224-b062-f94718d2db92" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.870498] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ea7b4af-4d3f-4224-b062-f94718d2db92',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.151097] env[69491]: INFO networking_nsxv3.common.synchronization [None req-7ebead0d-fdf0-47a1-a1c4-4382d1c13c03 None None] Enqueued Resource ID: d819874f-37df-436b-8b5a-a10464f9e1ea with Priority: HIGHEST for action port [ 693.152447] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d819874f-37df-436b-8b5a-a10464f9e1ea with Priority: HIGHEST for action port [ 693.152447] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d819874f-37df-436b-8b5a-a10464f9e1ea taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.152447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d819874f-37df-436b-8b5a-a10464f9e1ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.152447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d819874f-37df-436b-8b5a-a10464f9e1ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.152967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d819874f-37df-436b-8b5a-a10464f9e1ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.152967] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d819874f-37df-436b-8b5a-a10464f9e1ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.294112] env[69491]: INFO networking_nsxv3.common.synchronization [req-eaf4b774-1e26-4d57-8087-998c1a598bb1 req-fd8960df-ed44-49b1-90fd-3eafaa2136e4 tempest-SecurityGroupRulesTestJSON-1058747886 tempest-SecurityGroupRulesTestJSON-1058747886-project-member] Enqueued Resource ID: 1f3e7e58-99a8-45f9-ae78-52674d0edb14 with Priority: HIGHEST for action security_group_rules [ 693.294724] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3e7e58-99a8-45f9-ae78-52674d0edb14 with Priority: HIGHEST for action security_group_rules [ 693.295631] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f3e7e58-99a8-45f9-ae78-52674d0edb14 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.295782] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f3e7e58-99a8-45f9-ae78-52674d0edb14" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.296572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f3e7e58-99a8-45f9-ae78-52674d0edb14" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.296572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f3e7e58-99a8-45f9-ae78-52674d0edb14" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.296572] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f3e7e58-99a8-45f9-ae78-52674d0edb14',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.375010] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.375010] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.375010] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.376270] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.376637] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.377608] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 5ea7b4af-4d3f-4224-b062-f94718d2db92 not found, creating... [ 693.377608] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.377608] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.378072] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.378293] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.378476] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.378887] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.379479] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.379479] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.380696] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.380696] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.380696] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 5ea7b4af-4d3f-4224-b062-f94718d2db92 is going to be created. [ 693.406964] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.408063] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.408063] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.408063] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.408063] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.408433] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-5ea7b4af-4d3f-4224-b062-f94718d2db92" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.656824] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d819874f-37df-436b-8b5a-a10464f9e1ea [ 693.657111] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.657274] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.657353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.657701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.657799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.657903] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d819874f-37df-436b-8b5a-a10464f9e1ea already deleted. [ 693.657985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d819874f-37df-436b-8b5a-a10464f9e1ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.749194] env[69491]: INFO networking_nsxv3.common.synchronization [req-1dbb3d3c-788f-4fd8-89f4-05f845b782a4 req-0c638195-5bff-45ff-8642-eafb27fc7659 tempest-ServersV294TestFqdnHostnames-1976375908 tempest-ServersV294TestFqdnHostnames-1976375908-project-member] Enqueued Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGHEST for action security_group_members [ 693.749194] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGHEST for action security_group_members [ 693.749194] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0454f817-e35d-4717-870f-6288650eae31 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.749194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.749194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.749194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.749673] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.749673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.749673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.749806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.749845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.749937] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0454f817-e35d-4717-870f-6288650eae31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.819265] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.819466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.819466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.819818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.820199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.820199] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f3e7e58-99a8-45f9-ae78-52674d0edb14 already deleted. [ 693.820199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f3e7e58-99a8-45f9-ae78-52674d0edb14" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.095689] env[69491]: INFO networking_nsxv3.common.synchronization [None req-8ca56aff-656a-404a-8674-cff8f5824dec None None] Enqueued Resource ID: 5463a27e-aac7-47af-82a9-c0ab25c5289f with Priority: HIGHEST for action port [ 694.096364] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5463a27e-aac7-47af-82a9-c0ab25c5289f with Priority: HIGHEST for action port [ 694.097809] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-5463a27e-aac7-47af-82a9-c0ab25c5289f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.097809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5463a27e-aac7-47af-82a9-c0ab25c5289f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.097809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5463a27e-aac7-47af-82a9-c0ab25c5289f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.097809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5463a27e-aac7-47af-82a9-c0ab25c5289f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.097809] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5463a27e-aac7-47af-82a9-c0ab25c5289f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.116654] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: SUCCESS [ 694.116654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.116654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.116654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.116654] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.116654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.116654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.116654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.116654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.116654] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.253571] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.253800] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.253877] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.254123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.254250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.254474] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.254580] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.254658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.254884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.254921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.255023] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0454f817-e35d-4717-870f-6288650eae31 already deleted. [ 694.255413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.302279] env[69491]: INFO networking_nsxv3.common.synchronization [None req-152c61b3-9431-48b2-b04a-b574a3d375ba tempest-AttachInterfacesUnderV243Test-1007658330 tempest-AttachInterfacesUnderV243Test-1007658330-project-member] Enqueued Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_rules [ 694.302621] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_rules [ 694.303034] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.303133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.303173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.303416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.303499] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.425523] env[69491]: INFO networking_nsxv3.common.synchronization [None req-8fd49265-395e-44a7-a56f-4e30083f23f9 tempest-AttachInterfacesUnderV243Test-1007658330 tempest-AttachInterfacesUnderV243Test-1007658330-project-member] Enqueued Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_rules [ 694.426193] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_rules [ 694.426526] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.426656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.599406] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5463a27e-aac7-47af-82a9-c0ab25c5289f [ 694.600154] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.600299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.600486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.600594] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.600691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.600790] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5463a27e-aac7-47af-82a9-c0ab25c5289f already deleted. [ 694.600873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5463a27e-aac7-47af-82a9-c0ab25c5289f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.618370] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.828734] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.829112] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.829112] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.829284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.829523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.829523] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0b71710-cca2-4c0f-bcce-171044129d44 already deleted. [ 694.829523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.829708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.829833] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.829937] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.861180] env[69491]: INFO networking_nsxv3.common.synchronization [None req-e234d44e-cb04-4352-a263-cd0ce8cda7dc None None] Enqueued Resource ID: a6d52aab-1970-427f-9144-f1249107bf9d with Priority: HIGHEST for action port [ 694.861632] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6d52aab-1970-427f-9144-f1249107bf9d with Priority: HIGHEST for action port [ 694.862125] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6d52aab-1970-427f-9144-f1249107bf9d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.862283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6d52aab-1970-427f-9144-f1249107bf9d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.862357] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6d52aab-1970-427f-9144-f1249107bf9d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.863190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6d52aab-1970-427f-9144-f1249107bf9d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.863327] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6d52aab-1970-427f-9144-f1249107bf9d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.991022] env[69491]: INFO networking_nsxv3.common.synchronization [req-2a6b3f1f-22d8-4498-9d95-0ceb2c400dd6 req-2613f5aa-a786-42c0-bd54-9fa6ef2567c5 service nova] Enqueued Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_rules [ 694.991022] env[69491]: INFO networking_nsxv3.common.synchronization [req-2a6b3f1f-22d8-4498-9d95-0ceb2c400dd6 req-2613f5aa-a786-42c0-bd54-9fa6ef2567c5 service nova] Enqueued Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_members [ 694.991022] env[69491]: INFO networking_nsxv3.common.synchronization [req-2a6b3f1f-22d8-4498-9d95-0ceb2c400dd6 req-2613f5aa-a786-42c0-bd54-9fa6ef2567c5 service nova] Enqueued Resource ID: 5ea7b4af-4d3f-4224-b062-f94718d2db92 with Priority: HIGHEST for action port [ 694.991022] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_rules [ 694.991022] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_members [ 694.991022] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea7b4af-4d3f-4224-b062-f94718d2db92 with Priority: HIGHEST for action port [ 694.991022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.991022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.991022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.991022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.991022] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.992156] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.992156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.992156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.992156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.993268] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.993268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.993268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.993268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.993268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.993268] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.994151] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ea7b4af-4d3f-4224-b062-f94718d2db92 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.994253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ea7b4af-4d3f-4224-b062-f94718d2db92" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.994325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ea7b4af-4d3f-4224-b062-f94718d2db92" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.994521] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ea7b4af-4d3f-4224-b062-f94718d2db92" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.994644] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ea7b4af-4d3f-4224-b062-f94718d2db92',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.012658] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.012821] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-665" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.012863] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-665" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.013212] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-665" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.013805] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.013986] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.014375] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.014943] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.014943] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.015113] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.015230] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.015344] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.015464] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.015574] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.015685] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.015824] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.036398] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.036461] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 695.036604] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.036776] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-665" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.038215] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-c50059c1-6727-4ea5-9530-ba7d31a0d388 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.038215] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-c50059c1-6727-4ea5-9530-ba7d31a0d388" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.038215] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-c50059c1-6727-4ea5-9530-ba7d31a0d388" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.038215] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-c50059c1-6727-4ea5-9530-ba7d31a0d388" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.038215] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c50059c1-6727-4ea5-9530-ba7d31a0d388',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.121528] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.355935] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.356246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.356246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.356446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.356446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.356446] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0b71710-cca2-4c0f-bcce-171044129d44 already deleted. [ 695.356644] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.365770] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6d52aab-1970-427f-9144-f1249107bf9d [ 695.369024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.369024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.369024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.369024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.369024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.369024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6d52aab-1970-427f-9144-f1249107bf9d already deleted. [ 695.369024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6d52aab-1970-427f-9144-f1249107bf9d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.499624] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.499624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.499624] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.499624] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ea7b4af-4d3f-4224-b062-f94718d2db92 with status ACTIVE [ 695.499624] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.499624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.499624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.502098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.502379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.504075] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.504214] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.504285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.504493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.504569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.504893] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.505733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.505810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.505980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.506066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.506175] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ea7b4af-4d3f-4224-b062-f94718d2db92 is going to be updated. [ 695.536557] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.536876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.536954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.537212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.537496] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.537728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ea7b4af-4d3f-4224-b062-f94718d2db92" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.542321] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.543170] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.543170] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.544372] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.544564] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.544764] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port c50059c1-6727-4ea5-9530-ba7d31a0d388 not found, creating... [ 695.545200] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.546105] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.546105] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.546105] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.546266] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.546655] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.546854] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.546994] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.547333] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.547837] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.547837] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: c50059c1-6727-4ea5-9530-ba7d31a0d388 is going to be created. [ 695.573190] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.573441] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.573580] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.573883] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.574143] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.574380] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-c50059c1-6727-4ea5-9530-ba7d31a0d388" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.625116] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.625255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.625296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.628901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.628901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.628901] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 is going to be updated. [ 695.660968] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.660968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.660968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.661288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.661288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.691968] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: IN_PROGRESS for 2s [ 696.010234] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.024079] env[69491]: INFO networking_nsxv3.common.synchronization [None req-bd8184d4-4127-4fe5-9c65-8fda8d6cd454 tempest-VolumesAdminNegativeTest-1366311223 tempest-VolumesAdminNegativeTest-1366311223-project-member] Enqueued Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGHEST for action security_group_rules [ 696.028605] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGHEST for action security_group_rules [ 696.031587] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4084412-2aca-4bc0-a15c-1690668e51ea taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.031587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.031587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.031587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.031587] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.159216] env[69491]: INFO networking_nsxv3.common.synchronization [req-fa58c36b-ef17-4078-8edf-531a582ab43d req-ff0fdc88-ebd1-4898-91ae-fb85246a78b8 tempest-SecurityGroupRulesNegativeTestJSON-54402264 tempest-SecurityGroupRulesNegativeTestJSON-54402264-project-member] Enqueued Resource ID: 344fac71-2496-4d4a-97b3-0d284fb1b9d8 with Priority: HIGHEST for action security_group_rules [ 696.159960] env[69491]: INFO networking_nsxv3.common.synchronization [None req-6992a0ed-f053-484b-9f2f-a8c4b30c4af4 tempest-VolumesAdminNegativeTest-1366311223 tempest-VolumesAdminNegativeTest-1366311223-project-member] Enqueued Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGHEST for action security_group_rules [ 696.160850] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 344fac71-2496-4d4a-97b3-0d284fb1b9d8 with Priority: HIGHEST for action security_group_rules [ 696.160850] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGHEST for action security_group_rules [ 696.161053] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-344fac71-2496-4d4a-97b3-0d284fb1b9d8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.161304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-344fac71-2496-4d4a-97b3-0d284fb1b9d8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.161519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-344fac71-2496-4d4a-97b3-0d284fb1b9d8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.161773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-344fac71-2496-4d4a-97b3-0d284fb1b9d8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.161773] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('344fac71-2496-4d4a-97b3-0d284fb1b9d8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.163160] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4084412-2aca-4bc0-a15c-1690668e51ea taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.163160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.513735] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.513963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.513963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.514217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.514311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.514911] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a is going to be created. [ 696.555037] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.555037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.555037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.555037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.555037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.555037] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4084412-2aca-4bc0-a15c-1690668e51ea already deleted. [ 696.555037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.555037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.556537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.556537] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.562372] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.562875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.563111] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.565032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.565032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.577816] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: UNINITIALIZED for 2s [ 696.692431] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.692431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.692431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.692431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.692431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.692431] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 344fac71-2496-4d4a-97b3-0d284fb1b9d8 already deleted. [ 696.692431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-344fac71-2496-4d4a-97b3-0d284fb1b9d8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.081774] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.081774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.081774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.081774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.081774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.081774] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4084412-2aca-4bc0-a15c-1690668e51ea already deleted. [ 697.081774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.330468] env[69491]: INFO networking_nsxv3.common.synchronization [req-1dbb3d3c-788f-4fd8-89f4-05f845b782a4 req-f614ee83-c067-4294-bb79-76631e6127b3 service nova] Enqueued Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGHEST for action security_group_rules [ 697.330468] env[69491]: INFO networking_nsxv3.common.synchronization [req-1dbb3d3c-788f-4fd8-89f4-05f845b782a4 req-f614ee83-c067-4294-bb79-76631e6127b3 service nova] Enqueued Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGHEST for action security_group_members [ 697.330468] env[69491]: INFO networking_nsxv3.common.synchronization [req-1dbb3d3c-788f-4fd8-89f4-05f845b782a4 req-f614ee83-c067-4294-bb79-76631e6127b3 service nova] Enqueued Resource ID: c50059c1-6727-4ea5-9530-ba7d31a0d388 with Priority: HIGHEST for action port [ 697.330468] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGHEST for action security_group_rules [ 697.330468] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGHEST for action security_group_members [ 697.330468] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50059c1-6727-4ea5-9530-ba7d31a0d388 with Priority: HIGHEST for action port [ 697.330468] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0454f817-e35d-4717-870f-6288650eae31 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.330468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.330468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.330468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.330468] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0454f817-e35d-4717-870f-6288650eae31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.331736] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0454f817-e35d-4717-870f-6288650eae31 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.331736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.331736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.331736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.331736] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.331736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.332104] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.332104] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.332104] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.332104] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0454f817-e35d-4717-870f-6288650eae31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.333773] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-c50059c1-6727-4ea5-9530-ba7d31a0d388 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.333773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c50059c1-6727-4ea5-9530-ba7d31a0d388" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.333773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c50059c1-6727-4ea5-9530-ba7d31a0d388" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.333773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c50059c1-6727-4ea5-9530-ba7d31a0d388" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.333773] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c50059c1-6727-4ea5-9530-ba7d31a0d388',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.448156] env[69491]: INFO networking_nsxv3.common.synchronization [req-92b619ff-61ab-41cb-8d9b-251b82fa819f req-13f2a767-21c1-4015-aafd-2ead1c7005e8 tempest-SecurityGroupRulesTestJSON-1058747886 tempest-SecurityGroupRulesTestJSON-1058747886-project-member] Enqueued Resource ID: 819f03a6-1691-4c14-bc22-3e60aa555b54 with Priority: HIGHEST for action security_group_rules [ 697.449042] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 819f03a6-1691-4c14-bc22-3e60aa555b54 with Priority: HIGHEST for action security_group_rules [ 697.450159] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-819f03a6-1691-4c14-bc22-3e60aa555b54 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.450232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-819f03a6-1691-4c14-bc22-3e60aa555b54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.450314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-819f03a6-1691-4c14-bc22-3e60aa555b54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.450603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-819f03a6-1691-4c14-bc22-3e60aa555b54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.450708] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('819f03a6-1691-4c14-bc22-3e60aa555b54',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.704812] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: SUCCESS [ 697.705061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.705276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.705666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.705883] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.706637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.706637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.706637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.706637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.706637] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.835373] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0454f817-e35d-4717-870f-6288650eae31 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.835561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.835775] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0454f817-e35d-4717-870f-6288650eae31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.837364] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c50059c1-6727-4ea5-9530-ba7d31a0d388 with status ACTIVE [ 697.837604] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.837825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.837825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.838026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.838151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.838552] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.838552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.838552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.838552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.838736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.838864] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.838932] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.839038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.840151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.840272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.840358] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c50059c1-6727-4ea5-9530-ba7d31a0d388 is going to be updated. [ 697.864474] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.864659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.864701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.864988] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.865142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.865783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c50059c1-6727-4ea5-9530-ba7d31a0d388" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.989193] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.989193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.989193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.989193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.989193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.989193] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 819f03a6-1691-4c14-bc22-3e60aa555b54 already deleted. [ 697.989193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-819f03a6-1691-4c14-bc22-3e60aa555b54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.209782] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.342841] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0454f817-e35d-4717-870f-6288650eae31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.362422] env[69491]: INFO networking_nsxv3.common.synchronization [None req-04691167-2c99-4559-92c7-2f19626b2514 None None] Enqueued Resource ID: 2437f820-4ecf-478f-a0f0-1b0ef6c5f97a with Priority: HIGHEST for action port [ 698.362979] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2437f820-4ecf-478f-a0f0-1b0ef6c5f97a with Priority: HIGHEST for action port [ 698.363533] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-2437f820-4ecf-478f-a0f0-1b0ef6c5f97a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.363707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2437f820-4ecf-478f-a0f0-1b0ef6c5f97a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.363756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2437f820-4ecf-478f-a0f0-1b0ef6c5f97a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.364385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2437f820-4ecf-478f-a0f0-1b0ef6c5f97a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.364385] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2437f820-4ecf-478f-a0f0-1b0ef6c5f97a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.422935] env[69491]: INFO networking_nsxv3.common.synchronization [None req-913950f4-be88-49b1-8357-62652f9e518a None None] Enqueued Resource ID: 28911b01-3bae-405c-9713-e6d74ee652b0 with Priority: HIGHEST for action port [ 698.423301] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28911b01-3bae-405c-9713-e6d74ee652b0 with Priority: HIGHEST for action port [ 698.423852] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-28911b01-3bae-405c-9713-e6d74ee652b0 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.423980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28911b01-3bae-405c-9713-e6d74ee652b0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.424053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28911b01-3bae-405c-9713-e6d74ee652b0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.424816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28911b01-3bae-405c-9713-e6d74ee652b0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.424816] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28911b01-3bae-405c-9713-e6d74ee652b0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.588966] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: SUCCESS [ 698.589090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.589190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.589414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.589613] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.589731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.590114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.590114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.590114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.590114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.590361] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.712980] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.846962] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.847165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.847244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.847579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.847723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.847855] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0454f817-e35d-4717-870f-6288650eae31 is going to be created. [ 698.866343] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2437f820-4ecf-478f-a0f0-1b0ef6c5f97a [ 698.866766] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.866766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.866912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.868153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.868153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.868153] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2437f820-4ecf-478f-a0f0-1b0ef6c5f97a already deleted. [ 698.868301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2437f820-4ecf-478f-a0f0-1b0ef6c5f97a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.874975] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.874975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.874975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.874975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.874975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.887739] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0454f817-e35d-4717-870f-6288650eae31 in Status: UNINITIALIZED for 2s [ 698.927454] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28911b01-3bae-405c-9713-e6d74ee652b0 [ 698.928326] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.928326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.928326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.928482] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.928482] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.928630] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28911b01-3bae-405c-9713-e6d74ee652b0 already deleted. [ 698.928711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28911b01-3bae-405c-9713-e6d74ee652b0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.966799] env[69491]: INFO networking_nsxv3.common.synchronization [req-7de94d9e-42ea-4726-a15b-4c5c567a2a99 req-9f2bea87-fc94-45a1-b40f-56d65c68fda9 tempest-SecurityGroupRulesNegativeTestJSON-54402264 tempest-SecurityGroupRulesNegativeTestJSON-54402264-project-member] Enqueued Resource ID: 344fac71-2496-4d4a-97b3-0d284fb1b9d8 with Priority: HIGHEST for action security_group_rules [ 698.967385] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 344fac71-2496-4d4a-97b3-0d284fb1b9d8 with Priority: HIGHEST for action security_group_rules [ 698.967742] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-344fac71-2496-4d4a-97b3-0d284fb1b9d8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.967859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-344fac71-2496-4d4a-97b3-0d284fb1b9d8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.967923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-344fac71-2496-4d4a-97b3-0d284fb1b9d8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.968302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-344fac71-2496-4d4a-97b3-0d284fb1b9d8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.968841] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('344fac71-2496-4d4a-97b3-0d284fb1b9d8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.092042] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.092172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.092562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.092642] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.092782] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.092880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.092970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.093115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.093201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.093311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.093467] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.093563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.093617] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.093769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.093893] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.093985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.094058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.094330] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.094330] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.094443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.094443] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.130213] env[69491]: INFO networking_nsxv3.common.synchronization [req-3fc47a4b-efb5-4896-9e26-5928f1d5d65e req-be2ef790-41f0-4a9b-b7c5-05633fa66831 tempest-ImagesTestJSON-1178517317 tempest-ImagesTestJSON-1178517317-project-member] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 699.131076] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 699.132251] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.132251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.132251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.132606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.134156] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.134156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.134156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.134156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.134156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.134156] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.215275] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.215646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.215646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.215742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.215847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.215983] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 is going to be updated. [ 699.279183] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.279440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.279545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.279860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.280146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.299568] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: IN_PROGRESS for 2s [ 699.492570] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.492822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.492822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.493034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.493122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.493177] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 344fac71-2496-4d4a-97b3-0d284fb1b9d8 already deleted. [ 699.493282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-344fac71-2496-4d4a-97b3-0d284fb1b9d8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.600518] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d5a33a2-cab9-4479-9d1c-125f032b265a: rpc.has_security_group_logging(os_id): False [ 699.620954] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.621131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.621203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.621419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.621515] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.621713] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.621814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.621875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.622052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.622224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.622434] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.622531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.622594] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.622748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.622827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.623196] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.623589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.623663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.623822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.623905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.623992] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a is going to be created. [ 699.638931] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.639118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.639263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.639468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.639550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.639717] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.639912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.639912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.640081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.640163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.640290] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 699.671530] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.671697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.671957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.672032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.673199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.684935] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 699.701427] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.701427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.701427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.701427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.701427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.714974] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: IN_PROGRESS for 2s [ 700.892614] env[69491]: INFO networking_nsxv3.common.synchronization [req-7d8064f6-5399-4136-97df-7a0e1b97161f req-3be6b397-7721-406d-ae48-295428336d5d tempest-SecurityGroupRulesTestJSON-1058747886 tempest-SecurityGroupRulesTestJSON-1058747886-project-member] Enqueued Resource ID: 5c9072db-729d-41e2-ad4e-c3b429cc5e8f with Priority: HIGHEST for action security_group_rules [ 700.894917] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9072db-729d-41e2-ad4e-c3b429cc5e8f with Priority: HIGHEST for action security_group_rules [ 700.895681] env[69491]: INFO networking_nsxv3.common.synchronization [None req-eae3b827-9bc6-4668-984c-29a8b5d7643b None None] Enqueued Resource ID: b9643616-7586-4ba9-bb3c-40b313d42321 with Priority: HIGHEST for action port [ 700.896466] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.896585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.896664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.896946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.899516] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9072db-729d-41e2-ad4e-c3b429cc5e8f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.901580] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9643616-7586-4ba9-bb3c-40b313d42321 with Priority: HIGHEST for action port [ 700.905096] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9643616-7586-4ba9-bb3c-40b313d42321 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.905096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9643616-7586-4ba9-bb3c-40b313d42321" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.905096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9643616-7586-4ba9-bb3c-40b313d42321" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.905096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9643616-7586-4ba9-bb3c-40b313d42321" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.905096] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9643616-7586-4ba9-bb3c-40b313d42321',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.907050] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0454f817-e35d-4717-870f-6288650eae31 in Status: SUCCESS [ 700.907254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.911597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.911842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.912143] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.912253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.912253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.912860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.912958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.913053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.913177] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0454f817-e35d-4717-870f-6288650eae31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.153394] env[69491]: INFO networking_nsxv3.common.synchronization [req-a0bb1702-8025-43fd-a936-ed57d7b7096d req-875dbef0-e0b6-4f6d-ad88-7dc69a2f1189 tempest-ServerRescueNegativeTestJSON-1517573171 tempest-ServerRescueNegativeTestJSON-1517573171-project-member] Enqueued Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_members [ 701.154363] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_members [ 701.155041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.155041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.155041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.155041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.155282] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.155340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.156982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.156982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.156982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.156982] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.310896] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: SUCCESS [ 701.311166] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.311766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.312056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.312311] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.312438] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.314296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.314296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.314296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.314296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.314296] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.314296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.314296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.314296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.314296] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.314296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.314296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.314296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.314296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.314296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.314296] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.415226] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9643616-7586-4ba9-bb3c-40b313d42321 [ 701.415473] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.415641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.415715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.415932] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.419260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.419260] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9643616-7586-4ba9-bb3c-40b313d42321 already deleted. [ 701.419260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9643616-7586-4ba9-bb3c-40b313d42321" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.419260] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0454f817-e35d-4717-870f-6288650eae31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.429051] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.429051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.429051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.429051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.429051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.429051] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9072db-729d-41e2-ad4e-c3b429cc5e8f already deleted. [ 701.429817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.660983] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.660983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.660983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.661256] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.662694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.662943] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.663157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.663157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.663323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.663399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.663488] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88118802-dd47-4c99-a6fd-7180a306f792 already deleted. [ 701.663820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.695610] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 701.695875] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 deletion is rescheduled due to dependency. [ 701.696040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.728618] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: SUCCESS [ 701.728914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.805950] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-646 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.806171] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-646" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.806586] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-646" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.806685] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-646" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.808285] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.812362] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.812362] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.812362] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.812362] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.812362] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.812362] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.812362] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.812362] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.812362] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.812362] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.812362] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.816223] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1: rpc.has_security_group_logging(os_id): False [ 701.834626] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.834910] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 701.835375] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.835625] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-646" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.836622] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-f960943c-565e-4585-92e4-44ed54997b75 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.837145] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-f960943c-565e-4585-92e4-44ed54997b75" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.837145] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-f960943c-565e-4585-92e4-44ed54997b75" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.837551] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-f960943c-565e-4585-92e4-44ed54997b75" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.837862] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f960943c-565e-4585-92e4-44ed54997b75',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.840350] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.840350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.840350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.840350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.840350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.840598] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.840693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.840755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.840948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.841376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.841776] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.841891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.841960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.844610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.844610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.844610] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.844610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.844610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.844610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.844610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.844610] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 is going to be created. [ 701.902796] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.903136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.903136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.903279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.903443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.917234] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: IN_PROGRESS for 2s [ 701.922020] env[69491]: INFO networking_nsxv3.common.synchronization [req-763a86c2-5fcc-4897-82f4-06ce896ed530 req-49007ec0-fa7d-471e-bc60-1c9d5e7c1a65 tempest-SecurityGroupRulesTestJSON-1058747886 tempest-SecurityGroupRulesTestJSON-1058747886-project-member] Enqueued Resource ID: 5c9072db-729d-41e2-ad4e-c3b429cc5e8f with Priority: HIGHEST for action security_group_rules [ 701.922020] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9072db-729d-41e2-ad4e-c3b429cc5e8f with Priority: HIGHEST for action security_group_rules [ 701.922020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.922020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.922020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.922020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.922020] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9072db-729d-41e2-ad4e-c3b429cc5e8f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.922020] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0454f817-e35d-4717-870f-6288650eae31: rpc.has_security_group_logging(os_id): False [ 701.941276] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.941711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.941711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.941711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.941938] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.941997] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.942185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.942251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.942561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.942561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.942660] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0454f817-e35d-4717-870f-6288650eae31 is going to be created. [ 702.061487] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.061738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.061843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.062211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.062474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.082395] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0454f817-e35d-4717-870f-6288650eae31 in Status: IN_PROGRESS for 2s [ 702.345388] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.345610] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.345736] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.346102] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.346291] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.346467] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port f960943c-565e-4585-92e4-44ed54997b75 not found, creating... [ 702.346759] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.346929] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.347061] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.347617] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.347617] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.347773] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.347933] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.350713] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.350713] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.350713] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.350713] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: f960943c-565e-4585-92e4-44ed54997b75 is going to be created. [ 702.406518] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.406755] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.406885] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.407254] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.407431] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.407744] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-f960943c-565e-4585-92e4-44ed54997b75" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.442037] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.442037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.442037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.442037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.442341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.442341] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9072db-729d-41e2-ad4e-c3b429cc5e8f already deleted. [ 702.442341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.431576] env[69491]: INFO networking_nsxv3.common.synchronization [req-a0bb1702-8025-43fd-a936-ed57d7b7096d req-d12297de-e34d-4e1a-8ea6-f1ff962a0072 service nova] Enqueued Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_rules [ 703.431937] env[69491]: INFO networking_nsxv3.common.synchronization [req-a0bb1702-8025-43fd-a936-ed57d7b7096d req-d12297de-e34d-4e1a-8ea6-f1ff962a0072 service nova] Enqueued Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_members [ 703.431937] env[69491]: INFO networking_nsxv3.common.synchronization [req-a0bb1702-8025-43fd-a936-ed57d7b7096d req-d12297de-e34d-4e1a-8ea6-f1ff962a0072 service nova] Enqueued Resource ID: f960943c-565e-4585-92e4-44ed54997b75 with Priority: HIGHEST for action port [ 703.432201] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_rules [ 703.432299] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_members [ 703.432413] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f960943c-565e-4585-92e4-44ed54997b75 with Priority: HIGHEST for action port [ 703.434424] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.434424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.434424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.434424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.434424] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.438920] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.439093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.439168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.439373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.440091] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.440091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.440091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.440091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.440091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.440091] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.444852] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f960943c-565e-4585-92e4-44ed54997b75 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.444852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f960943c-565e-4585-92e4-44ed54997b75" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.445062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f960943c-565e-4585-92e4-44ed54997b75" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.445220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f960943c-565e-4585-92e4-44ed54997b75" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.445321] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f960943c-565e-4585-92e4-44ed54997b75',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.664781] env[69491]: INFO networking_nsxv3.common.synchronization [None req-cc0fafb4-5912-460d-be8f-011ee24c6482 None None] Enqueued Resource ID: 417186c2-5fee-483f-9827-ba916c6d6d7c with Priority: HIGHEST for action port [ 703.665079] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 417186c2-5fee-483f-9827-ba916c6d6d7c with Priority: HIGHEST for action port [ 703.665723] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-417186c2-5fee-483f-9827-ba916c6d6d7c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.666944] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-417186c2-5fee-483f-9827-ba916c6d6d7c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.667093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-417186c2-5fee-483f-9827-ba916c6d6d7c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.667581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-417186c2-5fee-483f-9827-ba916c6d6d7c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.667680] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('417186c2-5fee-483f-9827-ba916c6d6d7c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.935721] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: SUCCESS [ 703.935963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.936177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.936407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.936498] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.947798] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.947958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.948119] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.949487] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f960943c-565e-4585-92e4-44ed54997b75 with status ACTIVE [ 703.949487] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.949677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.949677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.949876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.949965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.950164] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.950423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.950423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.950523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.950557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.951116] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.951116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.951116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.951116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.959147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.959147] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f960943c-565e-4585-92e4-44ed54997b75 is going to be updated. [ 703.990640] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.990640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.990640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.990640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.990640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.990640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f960943c-565e-4585-92e4-44ed54997b75" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.107898] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0454f817-e35d-4717-870f-6288650eae31 in Status: SUCCESS [ 704.108197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.171127] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 417186c2-5fee-483f-9827-ba916c6d6d7c [ 704.171496] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.171496] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.171620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.171885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.172017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.172154] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:417186c2-5fee-483f-9827-ba916c6d6d7c already deleted. [ 704.172286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-417186c2-5fee-483f-9827-ba916c6d6d7c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.202928] env[69491]: INFO networking_nsxv3.common.synchronization [req-c2decbf7-90dd-47f9-96fe-95be62f0e4c1 req-7088cba8-4888-49c7-b226-f3ebcbdc73f2 tempest-ListServersNegativeTestJSON-1336340583 tempest-ListServersNegativeTestJSON-1336340583-project-member] Enqueued Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 704.205156] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 704.205156] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.205156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.205156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.205662] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.206113] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.206472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.206694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.208317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.208317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.208317] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.384233] env[69491]: INFO networking_nsxv3.common.synchronization [req-775b9508-970d-40ff-b38e-be46a4e62681 req-e714dfef-6be5-483e-9489-1a71e6d3d738 tempest-SecurityGroupRulesTestJSON-1058747886 tempest-SecurityGroupRulesTestJSON-1058747886-project-member] Enqueued Resource ID: 5c9072db-729d-41e2-ad4e-c3b429cc5e8f with Priority: HIGHEST for action security_group_rules [ 704.384972] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9072db-729d-41e2-ad4e-c3b429cc5e8f with Priority: HIGHEST for action security_group_rules [ 704.385508] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.385844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.385919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.386256] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.386345] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9072db-729d-41e2-ad4e-c3b429cc5e8f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.439472] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.439881] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.460982] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.621597] env[69491]: INFO networking_nsxv3.common.synchronization [req-54aff1a4-fcc1-4012-af55-494a9324d46a req-28cb6ce2-b754-4417-927a-e3ff342afc4d tempest-ImagesOneServerTestJSON-1348870833 tempest-ImagesOneServerTestJSON-1348870833-project-member] Enqueued Resource ID: 745f6209-d9d3-480b-9445-604b9585bfe0 with Priority: HIGHEST for action security_group_members [ 704.622589] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745f6209-d9d3-480b-9445-604b9585bfe0 with Priority: HIGHEST for action security_group_members [ 704.624960] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-745f6209-d9d3-480b-9445-604b9585bfe0 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.624960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.624960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.624960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.624960] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.624960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.624960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.624960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.624960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.624960] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745f6209-d9d3-480b-9445-604b9585bfe0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.710279] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.918477] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.918692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.918692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.918967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.918967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.919088] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9072db-729d-41e2-ad4e-c3b429cc5e8f already deleted. [ 704.919182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9072db-729d-41e2-ad4e-c3b429cc5e8f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.968315] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.968522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.968614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.968897] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.968999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.969172] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88118802-dd47-4c99-a6fd-7180a306f792 is going to be created. [ 704.998401] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.998497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.998497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.998772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.998981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.009043] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: UNINITIALIZED for 2s [ 705.128044] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.128044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.128044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.129271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.129443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.129762] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.129910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.130015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.130296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.130411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.130542] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745f6209-d9d3-480b-9445-604b9585bfe0 is going to be updated. [ 705.161249] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.161485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.161576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.161821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.161970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.173899] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745f6209-d9d3-480b-9445-604b9585bfe0 in Status: IN_PROGRESS for 2s [ 705.212756] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.715408] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.715775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.715775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.715996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.716146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.716274] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 is going to be updated. [ 705.750887] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.751085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.751402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.751402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.751563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.761940] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: IN_PROGRESS for 2s [ 707.025105] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: SUCCESS [ 707.025105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.025105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.025638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.025638] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.025638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.025788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.026090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.026090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.028785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.028785] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.190071] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745f6209-d9d3-480b-9445-604b9585bfe0 in Status: SUCCESS [ 707.190071] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745f6209-d9d3-480b-9445-604b9585bfe0 deletion is rescheduled due to dependency. [ 707.190071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745f6209-d9d3-480b-9445-604b9585bfe0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.531423] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.535024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.535024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.535024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.535024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.535857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.535857] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.778429] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: SUCCESS [ 707.778429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.778429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.778429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.778429] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.778429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.778429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.778429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.778429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.778429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.778429] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.037998] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88118802-dd47-4c99-a6fd-7180a306f792: rpc.has_security_group_logging(os_id): False [ 708.055872] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.055872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.055872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.056157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.056157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.057606] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.057606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.057606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.057606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.057606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.057606] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.057606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.057606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.057606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.057606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.057606] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.057606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.057606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.058248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.058248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.058248] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88118802-dd47-4c99-a6fd-7180a306f792 is going to be created. [ 708.125224] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.125402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.125498] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.128031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.128031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.140288] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: IN_PROGRESS for 2s [ 708.284253] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.284253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.284253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.284253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.284253] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.284253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.284253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.284253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.284253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.284253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.284253] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.284253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.284253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.284253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.284253] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.284253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.285352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.285352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.285352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.285352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.285352] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.785688] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1: rpc.has_security_group_logging(os_id): False [ 708.809795] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.810155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.810155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.810363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.810461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.810762] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.810881] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.810951] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.811206] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.811363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.811654] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.811810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.811885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.812140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.812225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.812413] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.812541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.812605] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.812905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.812975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.813117] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 is going to be updated. [ 708.887352] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.887352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.887352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.887352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.887352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.902549] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: IN_PROGRESS for 2s [ 709.624092] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 709.624409] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 709.848949] env[69491]: INFO networking_nsxv3.common.synchronization [req-7cd82a1f-1fcc-4a92-9b5c-2ca6d8e9af0f req-22c9c6fe-8984-4e60-b230-b151da3fed85 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 709.849535] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 709.849844] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.849988] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.850445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.850445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.850572] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.850682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.850747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.850915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.851032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.851138] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.152995] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: SUCCESS [ 710.153306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.353317] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.353443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.353579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.353824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.353909] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.354124] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.354216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.354277] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.354424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.354497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.354579] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 already deleted. [ 710.354929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.478272] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.478490] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.478719] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.478928] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.481536] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.481739] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.481897] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.482305] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.482530] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.482792] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.482990] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.483208] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.483449] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.483666] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.484615] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.484615] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.506108] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.506302] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 710.506451] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.506634] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.507076] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-b912359a-e015-4636-a343-c3a5ef2b8713 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.507202] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-b912359a-e015-4636-a343-c3a5ef2b8713" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.507386] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-b912359a-e015-4636-a343-c3a5ef2b8713" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.508251] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-b912359a-e015-4636-a343-c3a5ef2b8713" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.508251] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b912359a-e015-4636-a343-c3a5ef2b8713',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.918141] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: SUCCESS [ 710.918466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.918663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.919264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.919264] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.002957] env[69491]: INFO networking_nsxv3.common.synchronization [req-1aa4da47-a737-4b91-a97e-78020af9e8b0 req-07f73694-2336-4178-81b8-b6b581cb6044 tempest-ServersTestMultiNic-1676642349 tempest-ServersTestMultiNic-1676642349-project-member] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 711.003553] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 711.005039] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.005039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.005039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.005292] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.005415] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.005523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.005587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.005862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.005946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.006070] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.012897] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.013267] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.013399] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.014384] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.015091] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.015091] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port b912359a-e015-4636-a343-c3a5ef2b8713 not found, creating... [ 711.015091] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.015393] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.015464] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.015668] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.015814] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.016167] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.016388] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.016814] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.016814] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.016967] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.017118] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: b912359a-e015-4636-a343-c3a5ef2b8713 is going to be created. [ 711.044199] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.045013] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.045013] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.045013] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.045192] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.045400] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-b912359a-e015-4636-a343-c3a5ef2b8713" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.422469] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.422858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.422858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.423135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.423524] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.423524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.423524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.427375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.427375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.427375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.427375] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.512088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.512088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.512088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.512088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.512088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.512088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.512088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.512088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.512088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.512088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.512088] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 already deleted. [ 711.512088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.737314] env[69491]: INFO networking_nsxv3.common.synchronization [req-1aa4da47-a737-4b91-a97e-78020af9e8b0 req-67e89b96-1fd7-45b1-a19f-38f0bd0f80ce tempest-ServersTestMultiNic-1676642349 tempest-ServersTestMultiNic-1676642349-project-member] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 711.737976] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 711.740181] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.740465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.740465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.741093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.741093] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.741093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.741093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.741299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.741364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.742189] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.929811] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.930163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.930211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.930604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.930704] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.930779] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.930843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.931045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.931193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.931287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.931378] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.931590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.931682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.931917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.932161] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.932302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.932407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.932592] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.932724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.932856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.932971] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.244493] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.244738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.244845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.245228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.245354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.245629] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.245998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.245998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.246148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.246183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.246607] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 already deleted. [ 712.246607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.391049] env[69491]: INFO networking_nsxv3.common.synchronization [req-7cd82a1f-1fcc-4a92-9b5c-2ca6d8e9af0f req-66da3a25-1307-4501-b907-e4334f97c16d service nova] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_rules [ 712.391205] env[69491]: INFO networking_nsxv3.common.synchronization [req-7cd82a1f-1fcc-4a92-9b5c-2ca6d8e9af0f req-66da3a25-1307-4501-b907-e4334f97c16d service nova] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 712.391375] env[69491]: INFO networking_nsxv3.common.synchronization [req-7cd82a1f-1fcc-4a92-9b5c-2ca6d8e9af0f req-66da3a25-1307-4501-b907-e4334f97c16d service nova] Enqueued Resource ID: b912359a-e015-4636-a343-c3a5ef2b8713 with Priority: HIGHEST for action port [ 712.392205] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_rules [ 712.392423] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 712.392572] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b912359a-e015-4636-a343-c3a5ef2b8713 with Priority: HIGHEST for action port [ 712.392906] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.393133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.393233] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.393536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.393763] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.394616] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.396534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.396534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.396534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.396534] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.396534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.396534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.396534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.396534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.396534] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.397694] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b912359a-e015-4636-a343-c3a5ef2b8713 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.397694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b912359a-e015-4636-a343-c3a5ef2b8713" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.397694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b912359a-e015-4636-a343-c3a5ef2b8713" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.397694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b912359a-e015-4636-a343-c3a5ef2b8713" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.397694] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b912359a-e015-4636-a343-c3a5ef2b8713',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.440859] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1: rpc.has_security_group_logging(os_id): False [ 712.466040] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.466040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.466312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.466312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.466400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.466716] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.466814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.466814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.466987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.467101] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.467318] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.467411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.467469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.467615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.467763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.467965] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.468451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.470773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.470773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.470773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.470773] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 is going to be updated. [ 712.475993] env[69491]: INFO networking_nsxv3.common.synchronization [None req-f3c7c881-fe88-417e-8fe1-d734b71a2fc1 None None] Enqueued Resource ID: 3fafc1fb-bfe8-4d5f-aa01-9f8f77729b60 with Priority: HIGHEST for action port [ 712.476080] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fafc1fb-bfe8-4d5f-aa01-9f8f77729b60 with Priority: HIGHEST for action port [ 712.477280] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fafc1fb-bfe8-4d5f-aa01-9f8f77729b60 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.477420] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fafc1fb-bfe8-4d5f-aa01-9f8f77729b60" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.477482] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fafc1fb-bfe8-4d5f-aa01-9f8f77729b60" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.477859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fafc1fb-bfe8-4d5f-aa01-9f8f77729b60" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.477955] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fafc1fb-bfe8-4d5f-aa01-9f8f77729b60',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.544734] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.544974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.544974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.545187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.545409] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.589027] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: IN_PROGRESS for 2s [ 712.598474] env[69491]: INFO networking_nsxv3.common.synchronization [req-1aa4da47-a737-4b91-a97e-78020af9e8b0 req-ae00ee78-0a5f-4a4e-b114-ff23955cc903 tempest-ServersTestMultiNic-1676642349 tempest-ServersTestMultiNic-1676642349-project-member] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 712.599928] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 712.600697] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.600873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.601161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.601708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.601708] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.601847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.601918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.602326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.602326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.602456] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.899721] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.901019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.901227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.901360] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b912359a-e015-4636-a343-c3a5ef2b8713 with status ACTIVE [ 712.901528] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.904154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.904154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.904154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.904154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.904154] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.904154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.904154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.904154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.904154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.904154] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.904154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.904154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.904154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.904154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.904154] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b912359a-e015-4636-a343-c3a5ef2b8713 is going to be updated. [ 712.931796] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.932131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.932202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.932444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.932620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.932862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b912359a-e015-4636-a343-c3a5ef2b8713" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.984213] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fafc1fb-bfe8-4d5f-aa01-9f8f77729b60 [ 712.984213] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.984213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.984213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.984213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.984213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.984213] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fafc1fb-bfe8-4d5f-aa01-9f8f77729b60 already deleted. [ 712.984213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fafc1fb-bfe8-4d5f-aa01-9f8f77729b60" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.086756] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-501 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.086932] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-501" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.086987] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-501" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.088780] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-501" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.088780] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.088780] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.088780] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.088780] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.089165] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.089165] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.089441] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.089441] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.089589] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.089735] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.089903] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.090070] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.106068] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.106068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.106068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.106068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.106068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.106068] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.106068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.106068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.106571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.106571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.106571] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 already deleted. [ 713.106694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.113909] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.115747] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.115747] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.115747] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-501" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.115747] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-11f8ab2d-3375-41f6-ac08-2ac26e9ea745 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.115747] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-11f8ab2d-3375-41f6-ac08-2ac26e9ea745" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.115747] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-11f8ab2d-3375-41f6-ac08-2ac26e9ea745" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.115747] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-11f8ab2d-3375-41f6-ac08-2ac26e9ea745" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.116185] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11f8ab2d-3375-41f6-ac08-2ac26e9ea745',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.406671] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.618730] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.618988] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.619134] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.619420] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.619571] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.619731] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 11f8ab2d-3375-41f6-ac08-2ac26e9ea745 not found, creating... [ 713.620059] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.620172] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.620291] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.620517] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.620655] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.620943] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.621328] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.621467] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.624457] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.624672] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.624928] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 11f8ab2d-3375-41f6-ac08-2ac26e9ea745 is going to be created. [ 713.646181] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.647204] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.647204] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.647204] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.647204] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.647471] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-11f8ab2d-3375-41f6-ac08-2ac26e9ea745" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.909643] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.909834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.909887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.911757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.911757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.911757] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be created. [ 713.940639] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.941055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.941055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.941218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.941271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.953925] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: UNINITIALIZED for 2s [ 714.562152] env[69491]: INFO networking_nsxv3.common.synchronization [req-1aa4da47-a737-4b91-a97e-78020af9e8b0 req-75da65bd-6b87-4811-8ab8-e50afbaf01ce service nova] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_rules [ 714.562308] env[69491]: INFO networking_nsxv3.common.synchronization [req-1aa4da47-a737-4b91-a97e-78020af9e8b0 req-75da65bd-6b87-4811-8ab8-e50afbaf01ce service nova] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 714.562452] env[69491]: INFO networking_nsxv3.common.synchronization [req-1aa4da47-a737-4b91-a97e-78020af9e8b0 req-75da65bd-6b87-4811-8ab8-e50afbaf01ce service nova] Enqueued Resource ID: 11f8ab2d-3375-41f6-ac08-2ac26e9ea745 with Priority: HIGHEST for action port [ 714.563180] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_rules [ 714.563260] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 714.563325] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f8ab2d-3375-41f6-ac08-2ac26e9ea745 with Priority: HIGHEST for action port [ 714.563580] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.563723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.563805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.567046] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.567187] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.568901] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.572699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.572699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.572699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.572699] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.572699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.572699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.572699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.572699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.572699] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.573543] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-11f8ab2d-3375-41f6-ac08-2ac26e9ea745 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.573543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11f8ab2d-3375-41f6-ac08-2ac26e9ea745" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.573543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11f8ab2d-3375-41f6-ac08-2ac26e9ea745" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.573543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11f8ab2d-3375-41f6-ac08-2ac26e9ea745" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.573543] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11f8ab2d-3375-41f6-ac08-2ac26e9ea745',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.606302] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: SUCCESS [ 714.606589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.830436] env[69491]: INFO networking_nsxv3.common.synchronization [None req-dab19651-44df-48b0-8a25-007f2f6dfc0d tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGHEST for action security_group_rules [ 714.831042] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGHEST for action security_group_rules [ 714.831422] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62c4aff5-ba77-43c8-9eb6-a56da143180b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.832383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.832383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.832383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.832383] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.028209] env[69491]: INFO networking_nsxv3.common.synchronization [None req-49fd87d1-2878-4526-bcfc-898cdeb7e9d6 None None] Enqueued Resource ID: cd76c179-ae95-4e5b-adf6-dd74f2f9e3da with Priority: HIGHEST for action port [ 715.031960] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd76c179-ae95-4e5b-adf6-dd74f2f9e3da with Priority: HIGHEST for action port [ 715.031960] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd76c179-ae95-4e5b-adf6-dd74f2f9e3da taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.031960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd76c179-ae95-4e5b-adf6-dd74f2f9e3da" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.031960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd76c179-ae95-4e5b-adf6-dd74f2f9e3da" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.031960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd76c179-ae95-4e5b-adf6-dd74f2f9e3da" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.031960] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd76c179-ae95-4e5b-adf6-dd74f2f9e3da',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.060129] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-636 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.060361] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-636" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.060453] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-636" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.060852] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-636" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.061158] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.061362] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.061456] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.061742] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.061881] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.062182] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.062331] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.062442] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.062549] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.062661] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.062785] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.062997] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.069654] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.069812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.073483] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.075978] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11f8ab2d-3375-41f6-ac08-2ac26e9ea745 with status ACTIVE [ 715.076255] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.076341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.076400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.076611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.076709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.076890] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.076997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.077069] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.077248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.077329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.077514] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.077611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.077668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.077846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.077924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.078037] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11f8ab2d-3375-41f6-ac08-2ac26e9ea745 is going to be updated. [ 715.093172] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.093399] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.093509] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.093679] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-636" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.094105] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-5fa846c6-94ba-4cf1-8c60-55de878f6893 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.094313] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-5fa846c6-94ba-4cf1-8c60-55de878f6893" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.094436] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-5fa846c6-94ba-4cf1-8c60-55de878f6893" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.094847] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-5fa846c6-94ba-4cf1-8c60-55de878f6893" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.095036] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fa846c6-94ba-4cf1-8c60-55de878f6893',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.102349] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.102522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.102584] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.102809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.102986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.103157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11f8ab2d-3375-41f6-ac08-2ac26e9ea745" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.205933] env[69491]: INFO networking_nsxv3.common.synchronization [None req-8a3ed7b2-bc86-43b8-ae36-f0a4814e58e6 tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGHEST for action security_group_rules [ 715.206753] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGHEST for action security_group_rules [ 715.207023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62c4aff5-ba77-43c8-9eb6-a56da143180b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.228207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.357591] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.357827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.357884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.358150] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.358240] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.358336] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b already deleted. [ 715.358419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.358581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.359360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.359360] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.533153] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd76c179-ae95-4e5b-adf6-dd74f2f9e3da [ 715.533420] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.533566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.533637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.533878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.533976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.534089] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd76c179-ae95-4e5b-adf6-dd74f2f9e3da already deleted. [ 715.534174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd76c179-ae95-4e5b-adf6-dd74f2f9e3da" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.576234] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.598860] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.599127] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.599289] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.599621] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.599794] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.599959] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 5fa846c6-94ba-4cf1-8c60-55de878f6893 not found, creating... [ 715.600348] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.600505] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.600629] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.600892] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.601068] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.601386] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.601566] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.601659] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.601880] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.602026] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.602264] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 5fa846c6-94ba-4cf1-8c60-55de878f6893 is going to be created. [ 715.634047] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.634047] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.634047] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.634047] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.634047] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.634047] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-5fa846c6-94ba-4cf1-8c60-55de878f6893" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.893341] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.893604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.893604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.893775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.893864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.893962] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b already deleted. [ 715.894056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.963612] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 715.963869] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.964034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.964262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.964453] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.964593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.964641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.964780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.964862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.964951] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.965054] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.078555] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.078910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.078910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.079578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.079578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.079578] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be created. [ 716.106719] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.106719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.106719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.106719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.106719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.116975] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: UNINITIALIZED for 2s [ 716.469363] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.469536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.469611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.469912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.470637] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.470637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.470637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.470637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.470637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.470637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.470865] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.470865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.470955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.471142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.471287] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.471383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.471528] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.472055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.472055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.472055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.472055] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.687923] env[69491]: INFO networking_nsxv3.common.synchronization [req-1aa4da47-a737-4b91-a97e-78020af9e8b0 req-d192193d-3386-45c4-8ab5-0a33b8d0d037 service nova] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_rules [ 716.688054] env[69491]: INFO networking_nsxv3.common.synchronization [req-1aa4da47-a737-4b91-a97e-78020af9e8b0 req-d192193d-3386-45c4-8ab5-0a33b8d0d037 service nova] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 716.688237] env[69491]: INFO networking_nsxv3.common.synchronization [req-1aa4da47-a737-4b91-a97e-78020af9e8b0 req-d192193d-3386-45c4-8ab5-0a33b8d0d037 service nova] Enqueued Resource ID: 5fa846c6-94ba-4cf1-8c60-55de878f6893 with Priority: HIGHEST for action port [ 716.688751] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_rules [ 716.688995] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 716.689930] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa846c6-94ba-4cf1-8c60-55de878f6893 with Priority: HIGHEST for action port [ 716.690076] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.690262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.690420] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.690502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.691012] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fa846c6-94ba-4cf1-8c60-55de878f6893 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.691012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fa846c6-94ba-4cf1-8c60-55de878f6893" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.691012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fa846c6-94ba-4cf1-8c60-55de878f6893" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.691229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fa846c6-94ba-4cf1-8c60-55de878f6893" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.691275] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fa846c6-94ba-4cf1-8c60-55de878f6893',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.824337] env[69491]: INFO networking_nsxv3.common.synchronization [req-b8442ebc-3582-45ef-ae4a-40166af9b3fd req-9725c153-1257-4029-adca-82e87f69da5a tempest-ServerDiskConfigTestJSON-964931906 tempest-ServerDiskConfigTestJSON-964931906-project-member] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 716.824569] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 716.824891] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.825143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.825227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.825445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.825625] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.825705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.825762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.825915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.826023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.826108] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.976446] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9632268c-db1a-4548-9652-b638bc84b886: rpc.has_security_group_logging(os_id): False [ 716.998347] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.000762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.000762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.000762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.000762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.000762] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.000762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.000762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.000762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.000762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.000762] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.000762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.000762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.000762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.000762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.001244] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.001244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.001244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.001854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.001999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.002066] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be created. [ 717.067318] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.067729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.067729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.067840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.068084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.085954] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: IN_PROGRESS for 2s [ 717.195450] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fa846c6-94ba-4cf1-8c60-55de878f6893 with status ACTIVE [ 717.195838] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.199129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.199451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.200228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.200228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.200228] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.200228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.200228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.200228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.200569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.200569] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.200709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.200709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.200983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.200983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.201127] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fa846c6-94ba-4cf1-8c60-55de878f6893 is going to be updated. [ 717.239673] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.239871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.239959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.240259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.240405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.240602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fa846c6-94ba-4cf1-8c60-55de878f6893" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.331930] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.331930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.331930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.331930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.331930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.331930] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.331930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.331930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.331930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.331930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.331930] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 717.393894] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.394074] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.394149] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.394372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.394517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.411945] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 717.421123] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-956 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.421603] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.421816] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.422250] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.422675] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.422903] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.423162] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.423520] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.423745] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.424408] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.425521] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.425521] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.425521] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.425521] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.425700] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.426023] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.448347] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.448476] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.448554] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.448736] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.449080] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-9179baa2-90c1-4da7-9850-0eb0ed1308a3 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.449263] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-9179baa2-90c1-4da7-9850-0eb0ed1308a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.449512] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-9179baa2-90c1-4da7-9850-0eb0ed1308a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.449867] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-9179baa2-90c1-4da7-9850-0eb0ed1308a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.450108] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9179baa2-90c1-4da7-9850-0eb0ed1308a3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.766041] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-501 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.766041] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-501" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.766041] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-501" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.766272] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-501" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.766557] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.766722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.766842] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.767423] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.767666] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.768662] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.768662] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.768662] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.768662] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.768662] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.770510] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.770510] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.789266] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.789439] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.790043] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.790043] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-501" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.790236] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-98de11e9-39f9-4c3e-b886-3d7091af05c9 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.790340] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-98de11e9-39f9-4c3e-b886-3d7091af05c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.790461] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-98de11e9-39f9-4c3e-b886-3d7091af05c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.790798] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-98de11e9-39f9-4c3e-b886-3d7091af05c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.790938] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98de11e9-39f9-4c3e-b886-3d7091af05c9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.953063] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.953063] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.953063] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.953624] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.953911] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.954256] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 9179baa2-90c1-4da7-9850-0eb0ed1308a3 not found, creating... [ 717.956223] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.956223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.956223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.956223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.956223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.956607] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.956918] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.957141] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.957476] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.957712] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.958217] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 9179baa2-90c1-4da7-9850-0eb0ed1308a3 is going to be created. [ 717.996242] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.996242] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.996242] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.996242] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.996242] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.996242] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-9179baa2-90c1-4da7-9850-0eb0ed1308a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.132046] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 718.132415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.132593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.132812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.133013] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.133132] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.133196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.133350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.133426] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.133510] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.133606] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.134581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.134808] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.135115] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.135469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.135581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.135809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.135950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.136086] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.295906] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.298158] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.298158] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.298158] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.298158] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.298158] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 98de11e9-39f9-4c3e-b886-3d7091af05c9 not found, creating... [ 718.298158] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.301968] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.301968] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.301968] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.301968] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.301968] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.301968] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.301968] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.301968] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.301968] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.301968] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 98de11e9-39f9-4c3e-b886-3d7091af05c9 is going to be created. [ 718.329266] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.331722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.331722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.331722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.331722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.331722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-98de11e9-39f9-4c3e-b886-3d7091af05c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.638699] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.639470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.639470] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.103909] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 719.104184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.143386] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.422712] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 719.422965] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff deletion is rescheduled due to dependency. [ 719.423078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.645221] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.645641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.645641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.645819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.645819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.646699] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be updated. [ 719.679031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.679183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.679222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.680204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.680204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.692386] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 719.701950] env[69491]: INFO networking_nsxv3.common.synchronization [req-b8442ebc-3582-45ef-ae4a-40166af9b3fd req-9d9a3195-0755-461d-907f-371bf5b41cad service nova] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_rules [ 719.702158] env[69491]: INFO networking_nsxv3.common.synchronization [req-b8442ebc-3582-45ef-ae4a-40166af9b3fd req-9d9a3195-0755-461d-907f-371bf5b41cad service nova] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 719.702294] env[69491]: INFO networking_nsxv3.common.synchronization [req-b8442ebc-3582-45ef-ae4a-40166af9b3fd req-9d9a3195-0755-461d-907f-371bf5b41cad service nova] Enqueued Resource ID: 9179baa2-90c1-4da7-9850-0eb0ed1308a3 with Priority: HIGHEST for action port [ 719.702522] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_rules [ 719.702648] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 719.702745] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9179baa2-90c1-4da7-9850-0eb0ed1308a3 with Priority: HIGHEST for action port [ 719.703373] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.703481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.703545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.703752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.703841] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.707685] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.707821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.707914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.708163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.708323] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.708424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.708485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.709275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.709379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.709483] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.714584] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-9179baa2-90c1-4da7-9850-0eb0ed1308a3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.714738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9179baa2-90c1-4da7-9850-0eb0ed1308a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.714786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9179baa2-90c1-4da7-9850-0eb0ed1308a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.715012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9179baa2-90c1-4da7-9850-0eb0ed1308a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.715097] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9179baa2-90c1-4da7-9850-0eb0ed1308a3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.963065] env[69491]: INFO networking_nsxv3.common.synchronization [None req-2cdad553-5977-4bda-9d71-c90aa25f8515 None None] Enqueued Resource ID: 6dba7abb-478c-4461-9550-5dd7eb88110e with Priority: HIGHEST for action port [ 719.963653] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dba7abb-478c-4461-9550-5dd7eb88110e with Priority: HIGHEST for action port [ 719.964347] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dba7abb-478c-4461-9550-5dd7eb88110e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.964490] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dba7abb-478c-4461-9550-5dd7eb88110e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.964560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dba7abb-478c-4461-9550-5dd7eb88110e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.964832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dba7abb-478c-4461-9550-5dd7eb88110e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.964917] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dba7abb-478c-4461-9550-5dd7eb88110e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.217095] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.218584] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.218711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.219142] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9179baa2-90c1-4da7-9850-0eb0ed1308a3 with status ACTIVE [ 720.219142] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.219291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.219291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.221257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.221257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.221257] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.221257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.221257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.221257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.221257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.221257] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.221257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.221257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.221257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.221257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.221257] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9179baa2-90c1-4da7-9850-0eb0ed1308a3 is going to be updated. [ 720.250170] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.250303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.250385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.250600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.251121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.251121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9179baa2-90c1-4da7-9850-0eb0ed1308a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.321047] env[69491]: INFO networking_nsxv3.common.synchronization [req-1aa4da47-a737-4b91-a97e-78020af9e8b0 req-96717002-d2c3-476e-8fa4-84c3745ae4c9 service nova] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_rules [ 720.321251] env[69491]: INFO networking_nsxv3.common.synchronization [req-1aa4da47-a737-4b91-a97e-78020af9e8b0 req-96717002-d2c3-476e-8fa4-84c3745ae4c9 service nova] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 720.321392] env[69491]: INFO networking_nsxv3.common.synchronization [req-1aa4da47-a737-4b91-a97e-78020af9e8b0 req-96717002-d2c3-476e-8fa4-84c3745ae4c9 service nova] Enqueued Resource ID: 98de11e9-39f9-4c3e-b886-3d7091af05c9 with Priority: HIGHEST for action port [ 720.321846] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_rules [ 720.321981] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 720.322092] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98de11e9-39f9-4c3e-b886-3d7091af05c9 with Priority: HIGHEST for action port [ 720.322371] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.322477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.322674] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.322756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.322927] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-98de11e9-39f9-4c3e-b886-3d7091af05c9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.324136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98de11e9-39f9-4c3e-b886-3d7091af05c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.324136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98de11e9-39f9-4c3e-b886-3d7091af05c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.324136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98de11e9-39f9-4c3e-b886-3d7091af05c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.324272] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98de11e9-39f9-4c3e-b886-3d7091af05c9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.470460] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6dba7abb-478c-4461-9550-5dd7eb88110e [ 720.470460] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.470460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.470460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.470460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.470460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.470460] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6dba7abb-478c-4461-9550-5dd7eb88110e already deleted. [ 720.470460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dba7abb-478c-4461-9550-5dd7eb88110e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.723739] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.830583] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98de11e9-39f9-4c3e-b886-3d7091af05c9 with status ACTIVE [ 720.830583] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.830583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.830583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.830583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.830583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.830583] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.830583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.830583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.831070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.831070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.831070] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.831070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.831212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.831361] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.831361] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.831451] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98de11e9-39f9-4c3e-b886-3d7091af05c9 is going to be updated. [ 720.874646] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.874646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.874646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.874857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.874857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.875097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98de11e9-39f9-4c3e-b886-3d7091af05c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.226848] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.226848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.227276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.227276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.227751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.227751] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 721.466147] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.466147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.466147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.466147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.466147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.474845] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 721.704867] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 721.705110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.705358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.705605] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.708715] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.708715] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.708715] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.708715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.708715] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.710558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.710558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.710558] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.710558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.710558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.710558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.710558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.710558] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.211734] env[69491]: INFO networking_nsxv3.common.synchronization [None req-c6823224-9091-42eb-95b1-5b02d3e12134 None None] Enqueued Resource ID: 330f4f78-5131-46da-9034-8057e45fff05 with Priority: HIGHEST for action port [ 722.211734] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 415ca665-bf4f-490e-98cb-4ba509031109: rpc.has_security_group_logging(os_id): False [ 722.216056] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 330f4f78-5131-46da-9034-8057e45fff05 with Priority: HIGHEST for action port [ 722.216056] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.216528] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-330f4f78-5131-46da-9034-8057e45fff05 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.216644] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-330f4f78-5131-46da-9034-8057e45fff05" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.216644] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-330f4f78-5131-46da-9034-8057e45fff05" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.216948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-330f4f78-5131-46da-9034-8057e45fff05" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.217074] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('330f4f78-5131-46da-9034-8057e45fff05',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.245781] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.246137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.246137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.246523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.246720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.246974] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.247672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.247775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.248056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.248150] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.248772] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.248952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.249058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.249290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.252714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.252714] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.252714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.252714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.252714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.252714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.252714] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be created. [ 722.326288] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.326288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.326288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.328476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.328476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.343613] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 722.401074] env[69491]: INFO networking_nsxv3.common.synchronization [None req-2ba0d10c-6e43-4bb4-99c0-e0ca850f0eea None None] Enqueued Resource ID: 11d82cb7-2397-4e6c-8891-8c5c1cceed97 with Priority: HIGHEST for action port [ 722.401640] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11d82cb7-2397-4e6c-8891-8c5c1cceed97 with Priority: HIGHEST for action port [ 722.405363] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-11d82cb7-2397-4e6c-8891-8c5c1cceed97 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.405363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11d82cb7-2397-4e6c-8891-8c5c1cceed97" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.405522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11d82cb7-2397-4e6c-8891-8c5c1cceed97" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.408661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11d82cb7-2397-4e6c-8891-8c5c1cceed97" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.408661] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11d82cb7-2397-4e6c-8891-8c5c1cceed97',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.657336] env[69491]: INFO networking_nsxv3.common.synchronization [req-fb4e436b-05f6-4aa8-9671-030a70bf7ea1 req-09eeeecd-6a1b-4f22-967f-71a9210ab736 tempest-ServerRescueNegativeTestJSON-1517573171 tempest-ServerRescueNegativeTestJSON-1517573171-project-member] Enqueued Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_members [ 722.657949] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_members [ 722.658749] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.658749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.658749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.658895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.659214] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.659214] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.659631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.659631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.659631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.659631] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.720548] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.721824] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 330f4f78-5131-46da-9034-8057e45fff05 [ 722.721961] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.722141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.722210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.722618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.722716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.722965] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:330f4f78-5131-46da-9034-8057e45fff05 already deleted. [ 722.723025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-330f4f78-5131-46da-9034-8057e45fff05" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.908449] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11d82cb7-2397-4e6c-8891-8c5c1cceed97 [ 722.908729] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.909233] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.909329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.909567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.909636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.909732] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11d82cb7-2397-4e6c-8891-8c5c1cceed97 already deleted. [ 722.909811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11d82cb7-2397-4e6c-8891-8c5c1cceed97" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.161590] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.225348] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.225532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.225532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.225776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.225917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.226016] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be updated. [ 723.267103] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.268044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.268044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.268044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.268044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.278412] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 723.485985] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 723.486364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.491067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.491067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.491067] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.491067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.491067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.491067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.491067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.491067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.491067] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.640513] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-646 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.640513] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-646" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.640513] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-646" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.640513] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-646" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.650334] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.650334] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.650334] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.650334] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.650334] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.650334] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.650334] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.650334] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.650334] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.650334] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.650334] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.650334] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.663949] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.673187] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.673610] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 723.674953] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.675250] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-646" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.675657] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.677195] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.679241] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.679241] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.679241] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.991797] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.991988] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.992666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.992666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.992666] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.992666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.992883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.992883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.992955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.993674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.993674] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.993674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.993674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.993674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.993674] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.994053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.994053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.994053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.994053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.994053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.994195] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.170055] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.170055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.170055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.170055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.170055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.170055] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88118802-dd47-4c99-a6fd-7180a306f792 is going to be updated. [ 724.182669] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.182911] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.183058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.184476] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.184688] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.184857] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1 not found, creating... [ 724.185190] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.185359] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.185480] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.185730] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.185879] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.189946] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.192098] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.192098] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.192098] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.192098] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.192098] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1 is going to be created. [ 724.228277] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.228277] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.228277] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.228277] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.228277] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.229898] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.230553] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.230808] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.231233] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.231592] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.233039] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.243517] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: IN_PROGRESS for 2s [ 724.391482] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 724.391482] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.391482] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.391482] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.393119] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.617651] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab7773f0-7815-4a45-bf15-8a8079aa86ff: rpc.has_security_group_logging(os_id): False [ 724.638660] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.638827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.638866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.639089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.639177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.640015] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.640015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.640015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.640015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.640015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.640015] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.640015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.640295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.640295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.640295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.640502] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.640597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.640682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.640869] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.640983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.641148] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 724.706973] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.707153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.707208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.707447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.707593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.725744] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 724.761176] env[69491]: INFO networking_nsxv3.common.synchronization [None req-45043d57-6318-4413-9662-06474a3401ba tempest-ServerActionsV293TestJSON-872204216 tempest-ServerActionsV293TestJSON-872204216-project-member] Enqueued Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGHEST for action security_group_rules [ 724.761875] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGHEST for action security_group_rules [ 724.762235] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.762382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.762468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.762742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.762807] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c9d4b0f-923e-4454-badc-cbd5c63e211f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.897799] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.897962] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.258225] env[69491]: INFO networking_nsxv3.common.synchronization [None req-de1f7aa3-1297-4358-81af-e5dbc74acfec tempest-ServerActionsV293TestJSON-872204216 tempest-ServerActionsV293TestJSON-872204216-project-member] Enqueued Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGHEST for action security_group_rules [ 725.258929] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGHEST for action security_group_rules [ 725.259340] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.259443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.291063] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 725.291377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.291481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.291844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.292092] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.292352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.292352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.292506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.292618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.292713] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.292804] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.295026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.295026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.295026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.295275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.295387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.295502] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f already deleted. [ 725.295611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.295785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.296414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.296414] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c9d4b0f-923e-4454-badc-cbd5c63e211f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.549012] env[69491]: INFO networking_nsxv3.common.synchronization [None req-9239826d-e336-4932-af2d-0709f7f0255f None None] Enqueued Resource ID: 89bbe070-e2d2-41ea-994e-a931106ab19c with Priority: HIGHEST for action port [ 725.549786] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89bbe070-e2d2-41ea-994e-a931106ab19c with Priority: HIGHEST for action port [ 725.550372] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-89bbe070-e2d2-41ea-994e-a931106ab19c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.550669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89bbe070-e2d2-41ea-994e-a931106ab19c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.557063] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89bbe070-e2d2-41ea-994e-a931106ab19c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.557063] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89bbe070-e2d2-41ea-994e-a931106ab19c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.557063] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89bbe070-e2d2-41ea-994e-a931106ab19c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.576441] env[69491]: INFO networking_nsxv3.common.synchronization [None req-13e8b389-5406-436c-93d7-d6311c8b2d32 None None] Enqueued Resource ID: 1cb87f10-8d5d-4247-9101-349c46cddcd8 with Priority: HIGHEST for action port [ 725.576717] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb87f10-8d5d-4247-9101-349c46cddcd8 with Priority: HIGHEST for action port [ 725.577345] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cb87f10-8d5d-4247-9101-349c46cddcd8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.577476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cb87f10-8d5d-4247-9101-349c46cddcd8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.577543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cb87f10-8d5d-4247-9101-349c46cddcd8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.577799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cb87f10-8d5d-4247-9101-349c46cddcd8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.577879] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cb87f10-8d5d-4247-9101-349c46cddcd8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.798717] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.798919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.798977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.799211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.799389] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.799490] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.799555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.799710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.799798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.799892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.800141] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.800300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.800377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.800528] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.800666] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.800759] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.800834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.801009] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.801103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.801189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.801279] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.822119] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.822303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.822380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.822555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.822641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.822737] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f already deleted. [ 725.822815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.059288] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89bbe070-e2d2-41ea-994e-a931106ab19c [ 726.059288] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.059288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.059288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.059288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.059501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.059501] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89bbe070-e2d2-41ea-994e-a931106ab19c already deleted. [ 726.059725] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89bbe070-e2d2-41ea-994e-a931106ab19c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.083493] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1cb87f10-8d5d-4247-9101-349c46cddcd8 [ 726.083807] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.084451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.084606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.084912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.085069] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.085204] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1cb87f10-8d5d-4247-9101-349c46cddcd8 already deleted. [ 726.085298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cb87f10-8d5d-4247-9101-349c46cddcd8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.171198] env[69491]: INFO networking_nsxv3.common.synchronization [req-fb4e436b-05f6-4aa8-9671-030a70bf7ea1 req-8783da35-0d96-45ee-a9e8-1edef1f96fbe service nova] Enqueued Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_rules [ 726.171372] env[69491]: INFO networking_nsxv3.common.synchronization [req-fb4e436b-05f6-4aa8-9671-030a70bf7ea1 req-8783da35-0d96-45ee-a9e8-1edef1f96fbe service nova] Enqueued Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_members [ 726.171508] env[69491]: INFO networking_nsxv3.common.synchronization [req-fb4e436b-05f6-4aa8-9671-030a70bf7ea1 req-8783da35-0d96-45ee-a9e8-1edef1f96fbe service nova] Enqueued Resource ID: bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1 with Priority: HIGHEST for action port [ 726.171745] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_rules [ 726.171901] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_members [ 726.172137] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1 with Priority: HIGHEST for action port [ 726.172738] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.172866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.172931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.173606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.173727] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.175665] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.175802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.176088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.176542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.176639] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.176921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.177174] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.255284] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: SUCCESS [ 726.256334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.256602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.256873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.257169] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.257312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.257378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.257581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.257692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.257797] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.306143] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 415ca665-bf4f-490e-98cb-4ba509031109: rpc.has_security_group_logging(os_id): False [ 726.329771] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.329922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.329968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.331152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.331152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.331152] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.331152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.331152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.331152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.331152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.331452] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.331452] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.331452] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.331553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.331553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.331735] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.332329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.332329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.332329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.332629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.332760] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be updated. [ 726.450242] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.450338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.450375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.451089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.451089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.471602] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 726.678319] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.678319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.681523] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1 with status ACTIVE [ 726.681523] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.681523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.681716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.681918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.682043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.682264] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.682393] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.682502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.682651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.682733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.682962] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.683174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.683211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.683388] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.683497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.683594] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1 is going to be updated. [ 726.749279] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.749279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.749279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.749519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.749625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.749854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd73bb15-2470-4a3b-bf8e-b1cdb96af8c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.763488] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.770386] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 726.770602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.265784] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.768748] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.769154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.769154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.769266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.769354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.769469] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88118802-dd47-4c99-a6fd-7180a306f792 is going to be updated. [ 727.838750] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.838935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.838975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.839723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.839723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.850995] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: IN_PROGRESS for 2s [ 728.120189] env[69491]: INFO networking_nsxv3.common.synchronization [req-104e2ddd-89a8-4639-9c84-17ef34baa2fd req-8692bfcd-e44f-492d-a2d7-4c61b6ed8a64 tempest-ServerDiagnosticsNegativeTest-1164494036 tempest-ServerDiagnosticsNegativeTest-1164494036-project-member] Enqueued Resource ID: 378e4251-ff58-4c11-81e0-57e7d2509426 with Priority: HIGHEST for action security_group_members [ 728.121040] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378e4251-ff58-4c11-81e0-57e7d2509426 with Priority: HIGHEST for action security_group_members [ 728.121127] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-378e4251-ff58-4c11-81e0-57e7d2509426 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.121212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.121246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.121507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.122414] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.122414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.122414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.122414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.122414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.122635] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('378e4251-ff58-4c11-81e0-57e7d2509426',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.193888] env[69491]: INFO networking_nsxv3.common.synchronization [None req-8eb28b83-3cc1-407a-ac1e-163413360a29 None None] Enqueued Resource ID: 4f116b3e-cb03-4d3f-9759-c3c778086d66 with Priority: HIGHEST for action port [ 728.193888] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f116b3e-cb03-4d3f-9759-c3c778086d66 with Priority: HIGHEST for action port [ 728.193888] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f116b3e-cb03-4d3f-9759-c3c778086d66 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.193992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f116b3e-cb03-4d3f-9759-c3c778086d66" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.194195] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f116b3e-cb03-4d3f-9759-c3c778086d66" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.194399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f116b3e-cb03-4d3f-9759-c3c778086d66" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.194539] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f116b3e-cb03-4d3f-9759-c3c778086d66',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.516564] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 728.517279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.517499] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.517938] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.518118] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.624854] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.626446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.626446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.626446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.626446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.626446] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.626446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.626446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.626446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.626446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.626446] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 378e4251-ff58-4c11-81e0-57e7d2509426 already deleted. [ 728.626446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.699527] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f116b3e-cb03-4d3f-9759-c3c778086d66 [ 728.699714] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.699848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.699919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.700146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.700343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.700343] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f116b3e-cb03-4d3f-9759-c3c778086d66 already deleted. [ 728.700432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f116b3e-cb03-4d3f-9759-c3c778086d66" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.812166] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.812519] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.812604] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.812884] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.814756] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.814876] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.815034] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.815294] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.815462] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.815848] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.815848] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.815971] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.816270] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.816319] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.816439] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.816579] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.837442] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.838533] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.838533] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.838533] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.838533] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-e3f0eec3-9696-4b15-82f4-11f864b8aa2e taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.840958] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-e3f0eec3-9696-4b15-82f4-11f864b8aa2e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.840958] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-e3f0eec3-9696-4b15-82f4-11f864b8aa2e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.840958] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-e3f0eec3-9696-4b15-82f4-11f864b8aa2e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.840958] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3f0eec3-9696-4b15-82f4-11f864b8aa2e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.022378] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.022552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.022626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.022853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.023037] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.023144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.023209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.023358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.023444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.023532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.023621] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.343385] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.343633] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.343754] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.344061] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.344962] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.344962] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port e3f0eec3-9696-4b15-82f4-11f864b8aa2e not found, creating... [ 729.344962] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.344962] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.344962] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.345208] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.345317] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.345634] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.345758] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.345863] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.349382] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.349667] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.349864] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: e3f0eec3-9696-4b15-82f4-11f864b8aa2e is going to be created. [ 729.380781] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.381155] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.381302] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.381590] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.381831] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.382067] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-e3f0eec3-9696-4b15-82f4-11f864b8aa2e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.531019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.531519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.531519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.531634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.531744] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.535221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.535221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.535221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.535221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.535221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.536273] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.537710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.537710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.538194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.538454] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.538694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.543633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.543633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.543633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.543633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.543633] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.671664] env[69491]: INFO networking_nsxv3.common.synchronization [None req-554681a2-c526-46e6-bb16-5ab4146e6a35 None None] Enqueued Resource ID: 22e043d2-9542-4923-9e6f-099196df237e with Priority: HIGHEST for action port [ 729.671664] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e043d2-9542-4923-9e6f-099196df237e with Priority: HIGHEST for action port [ 729.671971] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-22e043d2-9542-4923-9e6f-099196df237e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.673309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22e043d2-9542-4923-9e6f-099196df237e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.673309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22e043d2-9542-4923-9e6f-099196df237e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.673674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22e043d2-9542-4923-9e6f-099196df237e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.673674] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22e043d2-9542-4923-9e6f-099196df237e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.871643] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: SUCCESS [ 729.872085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.872269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.872571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.875268] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.875268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.875268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.875268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.875268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.875268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.875268] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.048949] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 415ca665-bf4f-490e-98cb-4ba509031109: rpc.has_security_group_logging(os_id): False [ 730.074202] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.074495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.074495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.076732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.076732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.076732] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.076732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.076732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.076732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.076732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.076732] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.076732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.076732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.076732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.076732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.076732] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.077463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.077463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.077463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.078974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.079180] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be updated. [ 730.177942] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22e043d2-9542-4923-9e6f-099196df237e [ 730.177942] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.177942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.177942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.177942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.177942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.178704] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22e043d2-9542-4923-9e6f-099196df237e already deleted. [ 730.178820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22e043d2-9542-4923-9e6f-099196df237e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.185838] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.186127] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.186189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.186507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.186754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.211345] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 730.280623] env[69491]: INFO networking_nsxv3.common.synchronization [req-addbccfd-e850-4d00-b4d3-c1797d3beb26 req-7a5b6d1b-e321-4d7f-a684-f9fde4bfab25 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 730.284830] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 730.285227] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.285402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.285448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.285673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.286089] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.286089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.286089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.286269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.286269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.286387] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.383037] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.383037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.383037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.383037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.383037] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.383037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.383037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.383037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.383037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.383037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.383037] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.383037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.383037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.383037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.383037] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.383037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.383937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.383937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.383937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.383937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.383937] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.573769] env[69491]: INFO networking_nsxv3.common.synchronization [req-104e2ddd-89a8-4639-9c84-17ef34baa2fd req-881b01a1-0e2c-4ee6-a9ca-7748ba529e7c service nova] Enqueued Resource ID: 378e4251-ff58-4c11-81e0-57e7d2509426 with Priority: HIGHEST for action security_group_rules [ 730.573957] env[69491]: INFO networking_nsxv3.common.synchronization [req-104e2ddd-89a8-4639-9c84-17ef34baa2fd req-881b01a1-0e2c-4ee6-a9ca-7748ba529e7c service nova] Enqueued Resource ID: 378e4251-ff58-4c11-81e0-57e7d2509426 with Priority: HIGHEST for action security_group_members [ 730.574134] env[69491]: INFO networking_nsxv3.common.synchronization [req-104e2ddd-89a8-4639-9c84-17ef34baa2fd req-881b01a1-0e2c-4ee6-a9ca-7748ba529e7c service nova] Enqueued Resource ID: e3f0eec3-9696-4b15-82f4-11f864b8aa2e with Priority: HIGHEST for action port [ 730.574698] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378e4251-ff58-4c11-81e0-57e7d2509426 with Priority: HIGHEST for action security_group_rules [ 730.574950] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378e4251-ff58-4c11-81e0-57e7d2509426 with Priority: HIGHEST for action security_group_members [ 730.575135] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3f0eec3-9696-4b15-82f4-11f864b8aa2e with Priority: HIGHEST for action port [ 730.577211] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-378e4251-ff58-4c11-81e0-57e7d2509426 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.577211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.577211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.577211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.577211] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('378e4251-ff58-4c11-81e0-57e7d2509426',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.578103] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-378e4251-ff58-4c11-81e0-57e7d2509426 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.578298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.578340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.578570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.579472] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.579472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.579472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.579472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.579472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.579472] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('378e4251-ff58-4c11-81e0-57e7d2509426',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.580939] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3f0eec3-9696-4b15-82f4-11f864b8aa2e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.580939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3f0eec3-9696-4b15-82f4-11f864b8aa2e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.580939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3f0eec3-9696-4b15-82f4-11f864b8aa2e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.581237] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3f0eec3-9696-4b15-82f4-11f864b8aa2e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.581237] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3f0eec3-9696-4b15-82f4-11f864b8aa2e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.790548] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.790748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.790844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.791081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.791159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.791419] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.792034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.792034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.792034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.792034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.792034] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be updated. [ 730.834537] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.834774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.834832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.835536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.835536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.847765] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: IN_PROGRESS for 2s [ 730.889957] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88118802-dd47-4c99-a6fd-7180a306f792: rpc.has_security_group_logging(os_id): False [ 730.915830] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.915830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.915830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.915830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.915830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.915830] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.915830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.915830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.915830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.915830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.915830] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.915830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.915830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.915830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.915830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.916635] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.916635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.916635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.916635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.916635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.916765] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88118802-dd47-4c99-a6fd-7180a306f792 is going to be updated. [ 730.999569] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.999834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.999929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.000265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.000479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.019356] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: IN_PROGRESS for 2s [ 731.084289] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-378e4251-ff58-4c11-81e0-57e7d2509426 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.085234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.085539] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('378e4251-ff58-4c11-81e0-57e7d2509426',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.086604] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3f0eec3-9696-4b15-82f4-11f864b8aa2e with status ACTIVE [ 731.087153] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.087340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.087437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.087689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.087814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.088067] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.091044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.091044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.091044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.091044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.091044] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.091044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.091044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.091044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.091044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.091044] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3f0eec3-9696-4b15-82f4-11f864b8aa2e is going to be updated. [ 731.151561] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.151561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.151561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.151561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.151561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.151561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3f0eec3-9696-4b15-82f4-11f864b8aa2e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.594527] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('378e4251-ff58-4c11-81e0-57e7d2509426',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.098387] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.099064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.099064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.099064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.099064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.099064] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 378e4251-ff58-4c11-81e0-57e7d2509426 is going to be created. [ 732.126753] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.126753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.126753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.126753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.126753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.137042] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 378e4251-ff58-4c11-81e0-57e7d2509426 in Status: UNINITIALIZED for 2s [ 732.237478] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 732.237818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.862783] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 732.862783] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 deletion is rescheduled due to dependency. [ 732.862783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.036382] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: SUCCESS [ 733.037055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.040229] env[69491]: INFO networking_nsxv3.common.synchronization [req-79d64853-8670-41bf-9453-a1d1a7a6356d req-a4d82251-84fe-47a0-b58e-8fcd2c57abef tempest-VolumesAssistedSnapshotsTest-139761842 tempest-VolumesAssistedSnapshotsTest-139761842-project-member] Enqueued Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGHEST for action security_group_members [ 733.041397] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGHEST for action security_group_members [ 733.042060] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-00540613-7092-4498-a250-9bb6d721591a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.042358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.042579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.043152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.044795] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.044795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.044795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.044795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.044795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.044795] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00540613-7092-4498-a250-9bb6d721591a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.116659] env[69491]: INFO networking_nsxv3.common.synchronization [None req-0a9704d9-e420-49c2-bbfe-cd71f4934dc5 None None] Enqueued Resource ID: 3429f30d-200c-4269-8ab2-aa5191f67d4b with Priority: HIGHEST for action port [ 733.116659] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3429f30d-200c-4269-8ab2-aa5191f67d4b with Priority: HIGHEST for action port [ 733.116659] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-3429f30d-200c-4269-8ab2-aa5191f67d4b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.116659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3429f30d-200c-4269-8ab2-aa5191f67d4b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.116659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3429f30d-200c-4269-8ab2-aa5191f67d4b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.118126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3429f30d-200c-4269-8ab2-aa5191f67d4b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.119399] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3429f30d-200c-4269-8ab2-aa5191f67d4b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.249674] env[69491]: INFO networking_nsxv3.common.synchronization [req-611bdcd7-caf7-4f34-b7a0-5bc269a89427 req-ec9c8534-bfc8-44be-8483-19ad038c9b7c tempest-DeleteServersAdminTestJSON-986727250 tempest-DeleteServersAdminTestJSON-986727250-project-member] Enqueued Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_members [ 733.250882] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_members [ 733.252069] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.252382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.252643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.257359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.257359] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.257359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.257359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.257359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.257359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.257359] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.549638] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.549638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.549638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.549638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.549638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.549638] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.549638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.549638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.549638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.549638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.551216] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00540613-7092-4498-a250-9bb6d721591a is going to be updated. [ 733.590813] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.590813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.590813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.590813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.590813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.600856] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00540613-7092-4498-a250-9bb6d721591a in Status: IN_PROGRESS for 2s [ 733.620540] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3429f30d-200c-4269-8ab2-aa5191f67d4b [ 733.620794] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.620918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.620989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.621217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.621379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.621463] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3429f30d-200c-4269-8ab2-aa5191f67d4b already deleted. [ 733.621463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3429f30d-200c-4269-8ab2-aa5191f67d4b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.682894] env[69491]: INFO networking_nsxv3.common.synchronization [None req-043a39ee-2820-46f6-a4ea-8197750aea99 None None] Enqueued Resource ID: 08477e7a-1c83-447e-8908-bab6c15d54a2 with Priority: HIGHEST for action port [ 733.683706] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08477e7a-1c83-447e-8908-bab6c15d54a2 with Priority: HIGHEST for action port [ 733.684579] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-08477e7a-1c83-447e-8908-bab6c15d54a2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.685777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08477e7a-1c83-447e-8908-bab6c15d54a2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.685777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08477e7a-1c83-447e-8908-bab6c15d54a2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.685777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08477e7a-1c83-447e-8908-bab6c15d54a2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.685777] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08477e7a-1c83-447e-8908-bab6c15d54a2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.767052] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.767262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.767501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.768195] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.768344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.768606] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.768744] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.768798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.768956] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.769036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.769142] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 is going to be updated. [ 733.804807] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.805045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.807671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.807671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.807671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.822172] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: IN_PROGRESS for 2s [ 734.123914] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.124241] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.124605] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.124716] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.125077] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.125373] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.125909] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.125909] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.126105] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.126361] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.126520] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.126672] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.126933] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.127101] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.127253] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.127422] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.147922] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 378e4251-ff58-4c11-81e0-57e7d2509426 in Status: SUCCESS [ 734.148442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.148442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.148671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.148881] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.149033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.149144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.149272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.149369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.149898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.149898] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('378e4251-ff58-4c11-81e0-57e7d2509426',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.153012] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 734.153363] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 734.153516] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 734.153740] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.154128] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-00705d79-d777-4701-a4d5-183fe19cdf32 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.154408] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-00705d79-d777-4701-a4d5-183fe19cdf32" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.154629] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-00705d79-d777-4701-a4d5-183fe19cdf32" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.154993] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-00705d79-d777-4701-a4d5-183fe19cdf32" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.155223] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00705d79-d777-4701-a4d5-183fe19cdf32',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.188156] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08477e7a-1c83-447e-8908-bab6c15d54a2 [ 734.188744] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.188895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.188943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.189283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.189430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.189584] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08477e7a-1c83-447e-8908-bab6c15d54a2 already deleted. [ 734.189716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08477e7a-1c83-447e-8908-bab6c15d54a2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.656093] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-378e4251-ff58-4c11-81e0-57e7d2509426 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.656624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.656624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.656624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.657295] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.657295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.657295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.657295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.657295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.657295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.658999] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-378e4251-ff58-4c11-81e0-57e7d2509426 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.658999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.658999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.658999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.658999] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.658999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.658999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.658999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.658999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.658999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.658999] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('378e4251-ff58-4c11-81e0-57e7d2509426',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.660585] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.660585] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.660585] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.660585] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.660585] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.660585] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 00705d79-d777-4701-a4d5-183fe19cdf32 not found, creating... [ 734.660925] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.660984] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.665245] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.665585] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.665738] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.666107] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.666277] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.666395] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.666631] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.666830] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.667033] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 00705d79-d777-4701-a4d5-183fe19cdf32 is going to be created. [ 734.693028] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.693028] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.693028] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.693477] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.693477] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.693710] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-00705d79-d777-4701-a4d5-183fe19cdf32" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.144967] env[69491]: INFO networking_nsxv3.common.synchronization [req-ce43b05d-e5f3-4071-8a2c-1c5cd33af6fc req-230ad34b-5fc8-4cd8-80e7-c6e7ee918d60 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: f1812f0f-128b-41f6-987e-18e589d1ef41 with Priority: HIGHEST for action security_group_members [ 735.145565] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1812f0f-128b-41f6-987e-18e589d1ef41 with Priority: HIGHEST for action security_group_members [ 735.145873] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1812f0f-128b-41f6-987e-18e589d1ef41 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.145996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.149402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.150666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.151438] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.156511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.156511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.156511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.156511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.156511] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1812f0f-128b-41f6-987e-18e589d1ef41',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.169604] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 378e4251-ff58-4c11-81e0-57e7d2509426: rpc.has_security_group_logging(os_id): False [ 735.193912] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.195786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.195786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.195786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.195786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.195786] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.195786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.195786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.195786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.195786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.195786] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.195786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.195786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.196475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.196667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.199314] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.199314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.199314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.199314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.199314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.199314] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 378e4251-ff58-4c11-81e0-57e7d2509426 is going to be created. [ 735.274044] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.275647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.275964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.276667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.277308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.296901] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 378e4251-ff58-4c11-81e0-57e7d2509426 in Status: IN_PROGRESS for 2s [ 735.579022] env[69491]: INFO networking_nsxv3.common.synchronization [req-664ed6c6-3aeb-4aac-ac35-d70f5ed07e4f req-ba2d7ae0-ab02-4ce1-9e89-305dcf2070cf tempest-ServersTestMultiNic-1676642349 tempest-ServersTestMultiNic-1676642349-project-member] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 735.579571] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 735.579942] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.581736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.581847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.582200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.583040] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.587103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.587103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.587103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.587103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.587103] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.615269] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00540613-7092-4498-a250-9bb6d721591a in Status: SUCCESS [ 735.616535] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00540613-7092-4498-a250-9bb6d721591a deletion is rescheduled due to dependency. [ 735.617558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.661377] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.661540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.661614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.661851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.661968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.662198] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.662303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.662370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.662599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.662714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.662805] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1812f0f-128b-41f6-987e-18e589d1ef41 is going to be updated. [ 735.705395] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.705476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.705557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.705791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.705969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.720270] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1812f0f-128b-41f6-987e-18e589d1ef41 in Status: IN_PROGRESS for 2s [ 735.841117] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: SUCCESS [ 735.841164] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 deletion is rescheduled due to dependency. [ 735.841312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.091210] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.093144] env[69491]: INFO networking_nsxv3.common.synchronization [req-611bdcd7-caf7-4f34-b7a0-5bc269a89427 req-138438a7-31fb-4785-853f-c8fce2ed4a82 service nova] Enqueued Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_rules [ 736.093345] env[69491]: INFO networking_nsxv3.common.synchronization [req-611bdcd7-caf7-4f34-b7a0-5bc269a89427 req-138438a7-31fb-4785-853f-c8fce2ed4a82 service nova] Enqueued Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_members [ 736.093770] env[69491]: INFO networking_nsxv3.common.synchronization [req-611bdcd7-caf7-4f34-b7a0-5bc269a89427 req-138438a7-31fb-4785-853f-c8fce2ed4a82 service nova] Enqueued Resource ID: 00705d79-d777-4701-a4d5-183fe19cdf32 with Priority: HIGHEST for action port [ 736.094173] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_rules [ 736.094307] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_members [ 736.094402] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00705d79-d777-4701-a4d5-183fe19cdf32 with Priority: HIGHEST for action port [ 736.094673] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.094787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.094853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.095311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.095556] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.097251] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.097251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.097251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.097251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.097251] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.097251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.097251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.097478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.097891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.097891] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.099063] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-00705d79-d777-4701-a4d5-183fe19cdf32 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.099247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00705d79-d777-4701-a4d5-183fe19cdf32" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.099370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00705d79-d777-4701-a4d5-183fe19cdf32" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.099597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00705d79-d777-4701-a4d5-183fe19cdf32" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.099720] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00705d79-d777-4701-a4d5-183fe19cdf32',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.195582] env[69491]: INFO networking_nsxv3.common.synchronization [req-664ed6c6-3aeb-4aac-ac35-d70f5ed07e4f req-f798838f-96a7-4883-a8fb-7386610c46f9 tempest-ServersTestMultiNic-1676642349 tempest-ServersTestMultiNic-1676642349-project-member] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 736.196542] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 736.196542] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.196542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.595329] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.601921] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.607137] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.607316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.607548] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00705d79-d777-4701-a4d5-183fe19cdf32 with status ACTIVE [ 736.609017] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.609017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.609017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.609017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.609017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.609017] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.609017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.609017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.609017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.609017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.609345] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.609345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.609345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.609444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.609472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.609588] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00705d79-d777-4701-a4d5-183fe19cdf32 is going to be updated. [ 736.636787] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.636959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.637039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.637267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.637467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.637687] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00705d79-d777-4701-a4d5-183fe19cdf32" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.706223] env[69491]: INFO networking_nsxv3.common.synchronization [req-664ed6c6-3aeb-4aac-ac35-d70f5ed07e4f req-f0294c72-f496-42be-9041-41445f7cd2f5 tempest-ServersTestMultiNic-1676642349 tempest-ServersTestMultiNic-1676642349-project-member] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 736.706829] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 736.707323] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.707462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.781655] env[69491]: INFO networking_nsxv3.common.synchronization [None req-cc73cfcc-8318-447e-8fba-e748407a90d6 None None] Enqueued Resource ID: cf3c136a-b3c1-4172-9d5b-ba4cbea3624d with Priority: HIGHEST for action port [ 736.782285] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf3c136a-b3c1-4172-9d5b-ba4cbea3624d with Priority: HIGHEST for action port [ 736.782652] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf3c136a-b3c1-4172-9d5b-ba4cbea3624d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.782797] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf3c136a-b3c1-4172-9d5b-ba4cbea3624d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.782867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf3c136a-b3c1-4172-9d5b-ba4cbea3624d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.783261] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf3c136a-b3c1-4172-9d5b-ba4cbea3624d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.783351] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf3c136a-b3c1-4172-9d5b-ba4cbea3624d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.103106] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.103106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.103106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.103106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.103106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.103106] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be updated. [ 737.112039] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.143244] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.143244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.143244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.143244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.143244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.160045] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 737.286159] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf3c136a-b3c1-4172-9d5b-ba4cbea3624d [ 737.286992] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.288289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.288289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.288289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.288289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.288289] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf3c136a-b3c1-4172-9d5b-ba4cbea3624d already deleted. [ 737.288289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf3c136a-b3c1-4172-9d5b-ba4cbea3624d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.315049] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 378e4251-ff58-4c11-81e0-57e7d2509426 in Status: SUCCESS [ 737.315049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.384790] env[69491]: INFO networking_nsxv3.common.synchronization [req-d884d586-3c43-430c-aef6-28f7aa86a881 req-8a83e1bc-b1bb-487a-a59e-f04e380153ed tempest-ServerGroupTestJSON-1027954235 tempest-ServerGroupTestJSON-1027954235-project-member] Enqueued Resource ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 with Priority: HIGHEST for action security_group_members [ 737.386336] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 with Priority: HIGHEST for action security_group_members [ 737.387898] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72c0d6b-219d-45d0-992a-5e67f5d6c827 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.388408] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.388584] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.388992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.389382] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.389615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.389784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.390118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.390316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.390532] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d72c0d6b-219d-45d0-992a-5e67f5d6c827',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.615500] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.615655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.615746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.615968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.618044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.618044] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 is going to be updated. [ 737.651753] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.651942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.652026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.654362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.654562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.671256] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: IN_PROGRESS for 2s [ 737.731045] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1812f0f-128b-41f6-987e-18e589d1ef41 in Status: SUCCESS [ 737.731045] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1812f0f-128b-41f6-987e-18e589d1ef41 deletion is rescheduled due to dependency. [ 737.731045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1812f0f-128b-41f6-987e-18e589d1ef41" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.895269] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.895451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.895531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.895752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.895846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.896062] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.896163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.896247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.896481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.896481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.896559] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 already deleted. [ 737.896645] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.147934] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.148151] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.148341] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.148682] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.148951] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.149428] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.149654] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.149920] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.150085] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.150312] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.150432] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.150571] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.150685] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.150801] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.150911] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.155016] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.180405] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.180713] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.180778] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.180992] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.181477] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-416e5dfc-f4dd-4977-ad2c-ce687ddecf36 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.181653] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-416e5dfc-f4dd-4977-ad2c-ce687ddecf36" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.181879] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-416e5dfc-f4dd-4977-ad2c-ce687ddecf36" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.184113] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-416e5dfc-f4dd-4977-ad2c-ce687ddecf36" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.184423] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('416e5dfc-f4dd-4977-ad2c-ce687ddecf36',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.687697] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.688080] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.688127] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.691022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.691022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.691022] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 416e5dfc-f4dd-4977-ad2c-ce687ddecf36 not found, creating... [ 738.691022] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.691022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.691022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.691022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.691022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.691022] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.691022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.691428] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.691428] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.691428] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.691428] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 416e5dfc-f4dd-4977-ad2c-ce687ddecf36 is going to be created. [ 738.713313] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.713527] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.713656] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.713941] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.714391] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.714446] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-416e5dfc-f4dd-4977-ad2c-ce687ddecf36" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.171372] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 739.171600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.171778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.172006] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.172205] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.172409] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.172475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.172632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.172713] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.172808] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.677023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.677023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.677023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.677023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.677023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.677023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.677023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.677023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.677023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.677023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.677023] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be updated. [ 739.682889] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: SUCCESS [ 739.683187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.683395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.683600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.683783] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.683893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.683956] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.684110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.684186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.684272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.684360] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.710369] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.710787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.710787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.710787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.710907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.721101] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 740.153314] env[69491]: INFO networking_nsxv3.common.synchronization [req-d884d586-3c43-430c-aef6-28f7aa86a881 req-c443cb83-f766-4f4f-9ea3-1a575007b78d service nova] Enqueued Resource ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 with Priority: HIGHEST for action security_group_rules [ 740.153530] env[69491]: INFO networking_nsxv3.common.synchronization [req-d884d586-3c43-430c-aef6-28f7aa86a881 req-c443cb83-f766-4f4f-9ea3-1a575007b78d service nova] Enqueued Resource ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 with Priority: HIGHEST for action security_group_members [ 740.153721] env[69491]: INFO networking_nsxv3.common.synchronization [req-d884d586-3c43-430c-aef6-28f7aa86a881 req-c443cb83-f766-4f4f-9ea3-1a575007b78d service nova] Enqueued Resource ID: 416e5dfc-f4dd-4977-ad2c-ce687ddecf36 with Priority: HIGHEST for action port [ 740.154351] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 with Priority: HIGHEST for action security_group_rules [ 740.154530] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 with Priority: HIGHEST for action security_group_members [ 740.154696] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 416e5dfc-f4dd-4977-ad2c-ce687ddecf36 with Priority: HIGHEST for action port [ 740.159135] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d72c0d6b-219d-45d0-992a-5e67f5d6c827 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.159386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.159465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.159870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.159939] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d72c0d6b-219d-45d0-992a-5e67f5d6c827',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.161088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72c0d6b-219d-45d0-992a-5e67f5d6c827 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.161251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.161401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.161560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.161755] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.162219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.162219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.162219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.162383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.162383] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d72c0d6b-219d-45d0-992a-5e67f5d6c827',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.172376] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-416e5dfc-f4dd-4977-ad2c-ce687ddecf36 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.172537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-416e5dfc-f4dd-4977-ad2c-ce687ddecf36" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.172617] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-416e5dfc-f4dd-4977-ad2c-ce687ddecf36" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.172823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-416e5dfc-f4dd-4977-ad2c-ce687ddecf36" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.175031] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('416e5dfc-f4dd-4977-ad2c-ce687ddecf36',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.190028] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.190184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.190253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.190501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.190696] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.190831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.191066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.191126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.191234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.191921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.191921] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.191921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.191921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.191921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.192194] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.192272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.192355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.192529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.192685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.192762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.192876] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.676436] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72c0d6b-219d-45d0-992a-5e67f5d6c827 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.676436] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.676436] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d72c0d6b-219d-45d0-992a-5e67f5d6c827',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.678640] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 416e5dfc-f4dd-4977-ad2c-ce687ddecf36 with status ACTIVE [ 740.678640] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.678640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.681201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.681201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.681201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.681201] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.681201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.681201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.681201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.681201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.681201] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.681201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.681201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.681201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.681201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.681980] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 416e5dfc-f4dd-4977-ad2c-ce687ddecf36 is going to be updated. [ 740.695760] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5d9b441-54c3-4ef0-8866-aee0f17f0fb9: rpc.has_security_group_logging(os_id): False [ 740.718946] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.719478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.719478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.719478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.719603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.719750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-416e5dfc-f4dd-4977-ad2c-ce687ddecf36" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.723672] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.723818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.723920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.724135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.724228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.724413] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.724594] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.724594] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.724785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.724785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.724978] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.726045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.726045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.726045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.726045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.726045] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.726045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.726045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.726045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.726045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.726045] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 is going to be updated. [ 740.826874] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.827073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.827245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.827439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.827629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.850746] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: IN_PROGRESS for 2s [ 741.178967] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d72c0d6b-219d-45d0-992a-5e67f5d6c827',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.685121] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.685338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.685746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.685746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.685948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.685948] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 is going to be created. [ 741.717060] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.717060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.717060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.717431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.718389] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.731324] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 in Status: UNINITIALIZED for 2s [ 741.733518] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 741.733802] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 deletion is rescheduled due to dependency. [ 741.735331] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.735578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.735954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.736292] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.736529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.736637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.736862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.736958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.737098] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.240773] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.241008] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.241121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.241372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.241495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.241749] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.241929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.242076] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.242407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.242464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.242580] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be updated. [ 742.294405] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.294613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.294656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.294868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.295022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.306767] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 742.866610] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: SUCCESS [ 742.867045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.744887] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 in Status: SUCCESS [ 743.744887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.744887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.744887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.744887] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.744887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.744887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.744887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.744887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.744887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.744887] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d72c0d6b-219d-45d0-992a-5e67f5d6c827',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.250630] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72c0d6b-219d-45d0-992a-5e67f5d6c827 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.250924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.250924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.251098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.251758] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.252260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.252353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.252586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.252681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.252850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.253026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72c0d6b-219d-45d0-992a-5e67f5d6c827 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.253142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.253206] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.253369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.253519] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.253611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.253672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.253976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.253976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.253976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.256086] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d72c0d6b-219d-45d0-992a-5e67f5d6c827',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.319171] env[69491]: INFO networking_nsxv3.common.synchronization [req-5058230a-ca16-4670-893d-37fb11345de0 req-49915893-993e-4f16-88b0-c174b38d2b8f tempest-ServerDiagnosticsNegativeTest-1164494036 tempest-ServerDiagnosticsNegativeTest-1164494036-project-member] Enqueued Resource ID: 378e4251-ff58-4c11-81e0-57e7d2509426 with Priority: HIGHEST for action security_group_members [ 744.319171] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 744.319171] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 deletion is rescheduled due to dependency. [ 744.319171] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.320396] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378e4251-ff58-4c11-81e0-57e7d2509426 with Priority: HIGHEST for action security_group_members [ 744.321178] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-378e4251-ff58-4c11-81e0-57e7d2509426 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.321401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.321401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.321591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.321745] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.321862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.321924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.322086] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.322177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.322272] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('378e4251-ff58-4c11-81e0-57e7d2509426',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.550139] env[69491]: INFO networking_nsxv3.common.synchronization [req-51f4ef33-c6c6-4ef8-8751-28097427a815 req-3ed448e2-483e-489e-b352-05141b766bd9 tempest-ServersAdminNegativeTestJSON-1852575205 tempest-ServersAdminNegativeTestJSON-1852575205-project-member] Enqueued Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_members [ 744.550139] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_members [ 744.550139] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.550139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.550139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.551101] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.551418] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.551677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.551855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.552172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.552445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.553617] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.761977] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d72c0d6b-219d-45d0-992a-5e67f5d6c827: rpc.has_security_group_logging(os_id): False [ 744.785439] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.785653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.785717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.786019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.786124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.786366] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.786472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.786546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.790018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.790018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.790018] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.790018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.790018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.790018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.790018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.790018] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.790018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.790018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.790018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.790018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.790018] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 is going to be created. [ 744.824085] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.824251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.824324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.824535] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.824626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.824830] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.824945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.824983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.825249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.825670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.825670] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 378e4251-ff58-4c11-81e0-57e7d2509426 is going to be updated. [ 744.854370] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.854524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.854622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.854912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.855075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.867957] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 378e4251-ff58-4c11-81e0-57e7d2509426 in Status: IN_PROGRESS for 2s [ 744.880889] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.881119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.881119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.881323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.881501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.892979] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 in Status: IN_PROGRESS for 2s [ 745.061411] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.067240] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.067815] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.068035] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.068225] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.068542] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.068715] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.068837] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.069888] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.070377] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.070631] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.070758] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.070879] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.070991] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.071117] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.071227] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.071364] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.098549] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.098717] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.098823] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.099012] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.099602] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-3b37088d-6ce7-4742-8f6a-591ba0c8d117 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.099602] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-3b37088d-6ce7-4742-8f6a-591ba0c8d117" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.099790] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-3b37088d-6ce7-4742-8f6a-591ba0c8d117" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.099987] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-3b37088d-6ce7-4742-8f6a-591ba0c8d117" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.100176] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b37088d-6ce7-4742-8f6a-591ba0c8d117',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.564214] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.603561] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.606448] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.606448] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.606448] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.606448] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.606448] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 3b37088d-6ce7-4742-8f6a-591ba0c8d117 not found, creating... [ 745.606448] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.606448] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.606448] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.606448] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.606448] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.607784] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.608653] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.609260] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.611296] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.611296] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.611296] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 3b37088d-6ce7-4742-8f6a-591ba0c8d117 is going to be created. [ 745.636012] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.636712] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.636712] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.636861] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.636991] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.637237] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-3b37088d-6ce7-4742-8f6a-591ba0c8d117" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.068199] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.068199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.068199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.068672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.068672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.068672] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 is going to be updated. [ 746.114430] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.114697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.114697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.114866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.115031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.130584] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: IN_PROGRESS for 2s [ 746.771022] env[69491]: INFO networking_nsxv3.common.synchronization [req-29a33f58-ae8f-44d2-89fd-9317c3684ae1 req-7a056029-501f-4200-8613-e853763e42b9 tempest-ServersTestJSON-1393834495 tempest-ServersTestJSON-1393834495-project-member] Enqueued Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGHEST for action security_group_members [ 746.771022] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGHEST for action security_group_members [ 746.771022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70dddfb-485a-4313-8569-7ab012c8dc7e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.771635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.771804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.772144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.772418] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.772685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.772846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.774215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.774215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.774215] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b70dddfb-485a-4313-8569-7ab012c8dc7e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.879368] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 378e4251-ff58-4c11-81e0-57e7d2509426 in Status: SUCCESS [ 746.879368] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 378e4251-ff58-4c11-81e0-57e7d2509426 deletion is rescheduled due to dependency. [ 746.879368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.911908] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 in Status: SUCCESS [ 746.911908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.220127] env[69491]: INFO networking_nsxv3.common.synchronization [req-51f4ef33-c6c6-4ef8-8751-28097427a815 req-17568bd0-7a73-4e47-9a91-c444c457050c service nova] Enqueued Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_rules [ 747.221210] env[69491]: INFO networking_nsxv3.common.synchronization [req-51f4ef33-c6c6-4ef8-8751-28097427a815 req-17568bd0-7a73-4e47-9a91-c444c457050c service nova] Enqueued Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_members [ 747.221210] env[69491]: INFO networking_nsxv3.common.synchronization [req-51f4ef33-c6c6-4ef8-8751-28097427a815 req-17568bd0-7a73-4e47-9a91-c444c457050c service nova] Enqueued Resource ID: 3b37088d-6ce7-4742-8f6a-591ba0c8d117 with Priority: HIGHEST for action port [ 747.225764] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_rules [ 747.225764] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_members [ 747.225764] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b37088d-6ce7-4742-8f6a-591ba0c8d117 with Priority: HIGHEST for action port [ 747.225764] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.225764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.225764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.225764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.225764] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.225764] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.226327] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.227396] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b37088d-6ce7-4742-8f6a-591ba0c8d117 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.228047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b37088d-6ce7-4742-8f6a-591ba0c8d117" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.228316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b37088d-6ce7-4742-8f6a-591ba0c8d117" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.228686] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b37088d-6ce7-4742-8f6a-591ba0c8d117" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.228915] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b37088d-6ce7-4742-8f6a-591ba0c8d117',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.279024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.279024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.279024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.279024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.279024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.279024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.279024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.279024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.279024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.279024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.279024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70dddfb-485a-4313-8569-7ab012c8dc7e is going to be updated. [ 747.296030] env[69491]: INFO networking_nsxv3.common.synchronization [req-6f1c25a5-4bd0-4eb6-b971-a3ffa379bb9f req-533a3629-b028-423d-b266-392727ba46e1 tempest-ServersV294TestFqdnHostnames-1976375908 tempest-ServersV294TestFqdnHostnames-1976375908-project-member] Enqueued Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGHEST for action security_group_members [ 747.296030] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGHEST for action security_group_members [ 747.297036] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0454f817-e35d-4717-870f-6288650eae31 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.297487] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.297664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.297992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.298487] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.301243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.301243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.301243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.301243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.301243] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0454f817-e35d-4717-870f-6288650eae31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.311023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.313019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.313019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.313019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.313019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.328246] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70dddfb-485a-4313-8569-7ab012c8dc7e in Status: IN_PROGRESS for 2s [ 747.731613] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.734035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.734083] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b37088d-6ce7-4742-8f6a-591ba0c8d117 with status ACTIVE [ 747.734847] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.734847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.734847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.734847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.735049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.735221] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.735375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.735481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.735715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.735809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.736017] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.736109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.736170] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.736313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.736384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.736494] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b37088d-6ce7-4742-8f6a-591ba0c8d117 is going to be updated. [ 747.760148] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.761241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.761241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.761241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.761241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.761241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b37088d-6ce7-4742-8f6a-591ba0c8d117" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.806355] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.806717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.806717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.806979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.807127] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.807690] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.807690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.807690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.807914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.807959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.808085] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0454f817-e35d-4717-870f-6288650eae31 is going to be updated. [ 747.882514] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.882514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.882514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.882514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.882514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.909753] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0454f817-e35d-4717-870f-6288650eae31 in Status: IN_PROGRESS for 2s [ 748.151024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: SUCCESS [ 748.151382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.151639] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.151957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.152444] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.152444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.152626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.152708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.152836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.152991] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.656805] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.157803] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.340385] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70dddfb-485a-4313-8569-7ab012c8dc7e in Status: SUCCESS [ 749.345487] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70dddfb-485a-4313-8569-7ab012c8dc7e deletion is rescheduled due to dependency. [ 749.345641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.664035] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.664035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.664035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.664035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.664035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.664035] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 is going to be updated. [ 749.705967] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.705967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.705967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.705967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.705967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.717405] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: IN_PROGRESS for 2s [ 749.926321] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0454f817-e35d-4717-870f-6288650eae31 in Status: SUCCESS [ 749.926321] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0454f817-e35d-4717-870f-6288650eae31 deletion is rescheduled due to dependency. [ 749.926321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.736305] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: SUCCESS [ 751.736664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.736749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.736942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.737156] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.737279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.737348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.737497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.737577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.737666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.737757] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.754020] env[69491]: INFO networking_nsxv3.common.synchronization [req-3d0fa20f-6e9c-4c0c-8245-d1180c0cff98 req-80bda04f-9c3b-41b4-8028-43f0f1dfc08f tempest-ServerDiskConfigTestJSON-964931906 tempest-ServerDiskConfigTestJSON-964931906-project-member] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 751.754020] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 751.754020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.754020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.754969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.755249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.755437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.755548] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.755611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.755771] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.755853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.755949] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.241584] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.241761] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.241835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.242765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.242765] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.242765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.242765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.242765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.242765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.243181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.243181] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.243181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.243341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.243454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.243611] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.243706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.243815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.243926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.244423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.244544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.244661] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.260054] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.260170] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.260231] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.260416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.260507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.260709] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.260811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.260866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.261017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.261091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.261200] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 752.277991] env[69491]: INFO networking_nsxv3.common.synchronization [req-ff38d24c-e0c6-4237-80b9-92beeef30055 req-3141fb5a-7eb8-4c61-ab75-d836c37da699 tempest-InstanceActionsV221TestJSON-1582933430 tempest-InstanceActionsV221TestJSON-1582933430-project-member] Enqueued Resource ID: f0db36d0-bbf1-4643-8661-68a84fdee418 with Priority: HIGHEST for action security_group_members [ 752.280208] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0db36d0-bbf1-4643-8661-68a84fdee418 with Priority: HIGHEST for action security_group_members [ 752.280947] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0db36d0-bbf1-4643-8661-68a84fdee418 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.281273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.281416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.283418] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.283696] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.283832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.283917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.284432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.284432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.284432] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0db36d0-bbf1-4643-8661-68a84fdee418',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.296028] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.296028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.296028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.296028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.296028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.305058] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 752.750308] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c5808a0-5aae-42f0-89ec-a7d1d00bc588: rpc.has_security_group_logging(os_id): False [ 752.788447] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.788711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.788711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.788895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.788991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.789208] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.789305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.789368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.789517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.789815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.789815] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0db36d0-bbf1-4643-8661-68a84fdee418 already deleted. [ 752.789815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.835238] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.835238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.835238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.835238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.835238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.835238] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.835238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.835238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.835238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.836174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.836174] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.836174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.836174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.836174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.836174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.836470] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.836470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.836470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.836754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.836851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.836948] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 is going to be updated. [ 752.850427] env[69491]: INFO networking_nsxv3.common.synchronization [req-0d16fc17-70a2-41c4-a2cf-7dea6398fd8b req-bf49a2ac-df23-48bc-ac17-4b4a06261084 tempest-DeleteServersAdminTestJSON-986727250 tempest-DeleteServersAdminTestJSON-986727250-project-member] Enqueued Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_members [ 752.851056] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGHEST for action security_group_members [ 752.851415] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.852098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.852241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.852392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.852632] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.852714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.852714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.852859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.852940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.853045] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.930452] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-968 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.930703] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-968" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.930898] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-968" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.931322] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-968" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.931573] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.931779] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.931907] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.932164] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.932313] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.932569] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.932758] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.932903] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.933031] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.933158] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.933269] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.933406] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.972506] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.972839] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 752.973376] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.973544] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-968" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.973901] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-b6f2ee71-88dd-4e1c-9f61-1d3641ffca42 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.977024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-b6f2ee71-88dd-4e1c-9f61-1d3641ffca42" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.977024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-b6f2ee71-88dd-4e1c-9f61-1d3641ffca42" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.977024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-b6f2ee71-88dd-4e1c-9f61-1d3641ffca42" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.977024] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6f2ee71-88dd-4e1c-9f61-1d3641ffca42',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.039739] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.039907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.039979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.040210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.040360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.067700] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: IN_PROGRESS for 2s [ 753.359543] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.360686] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.360775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.361109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.361229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.361473] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.361585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.361639] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.361793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.361868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.361957] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 is going to be updated. [ 753.423117] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.428212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.428212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.428212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.428212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.439092] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: IN_PROGRESS for 2s [ 753.478423] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.478761] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.478905] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.479290] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.479429] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.479594] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port b6f2ee71-88dd-4e1c-9f61-1d3641ffca42 not found, creating... [ 753.479926] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.480281] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.480281] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.480549] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.480549] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.480933] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.483755] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.484043] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.484436] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.484625] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.484800] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: b6f2ee71-88dd-4e1c-9f61-1d3641ffca42 is going to be created. [ 753.515398] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.515610] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.515876] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.516233] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.516550] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.516812] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-b6f2ee71-88dd-4e1c-9f61-1d3641ffca42" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.328475] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 754.328831] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff deletion is rescheduled due to dependency. [ 754.329008] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.427685] env[69491]: INFO networking_nsxv3.common.synchronization [req-ff38d24c-e0c6-4237-80b9-92beeef30055 req-2e841384-82c1-48d2-aa0c-0dbd6ba73b4a service nova] Enqueued Resource ID: f0db36d0-bbf1-4643-8661-68a84fdee418 with Priority: HIGHEST for action security_group_rules [ 754.427685] env[69491]: INFO networking_nsxv3.common.synchronization [req-ff38d24c-e0c6-4237-80b9-92beeef30055 req-2e841384-82c1-48d2-aa0c-0dbd6ba73b4a service nova] Enqueued Resource ID: f0db36d0-bbf1-4643-8661-68a84fdee418 with Priority: HIGHEST for action security_group_members [ 754.428033] env[69491]: INFO networking_nsxv3.common.synchronization [req-ff38d24c-e0c6-4237-80b9-92beeef30055 req-2e841384-82c1-48d2-aa0c-0dbd6ba73b4a service nova] Enqueued Resource ID: b6f2ee71-88dd-4e1c-9f61-1d3641ffca42 with Priority: HIGHEST for action port [ 754.428033] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0db36d0-bbf1-4643-8661-68a84fdee418 with Priority: HIGHEST for action security_group_rules [ 754.428196] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0db36d0-bbf1-4643-8661-68a84fdee418 with Priority: HIGHEST for action security_group_members [ 754.428253] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6f2ee71-88dd-4e1c-9f61-1d3641ffca42 with Priority: HIGHEST for action port [ 754.428891] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0db36d0-bbf1-4643-8661-68a84fdee418 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.429208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.429353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.429570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.429689] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0db36d0-bbf1-4643-8661-68a84fdee418',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.432398] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0db36d0-bbf1-4643-8661-68a84fdee418 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.432398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.432535] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.432711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.432898] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.433014] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.433150] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.433335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.436493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.436653] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0db36d0-bbf1-4643-8661-68a84fdee418',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.438241] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6f2ee71-88dd-4e1c-9f61-1d3641ffca42 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.439115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6f2ee71-88dd-4e1c-9f61-1d3641ffca42" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.439115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6f2ee71-88dd-4e1c-9f61-1d3641ffca42" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.439115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6f2ee71-88dd-4e1c-9f61-1d3641ffca42" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.439115] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6f2ee71-88dd-4e1c-9f61-1d3641ffca42',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.932987] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0db36d0-bbf1-4643-8661-68a84fdee418 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.933201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.942103] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6f2ee71-88dd-4e1c-9f61-1d3641ffca42 with status ACTIVE [ 754.942368] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.942540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.942622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.942787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.942878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.943072] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.943175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.943228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.943382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.943460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.943644] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.943742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.943803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.943935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.943935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.944131] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6f2ee71-88dd-4e1c-9f61-1d3641ffca42 is going to be updated. [ 754.947614] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0db36d0-bbf1-4643-8661-68a84fdee418',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.983624] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.983907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.983907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.984126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.984282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.984475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6f2ee71-88dd-4e1c-9f61-1d3641ffca42" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.086192] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: SUCCESS [ 755.086428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.447241] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 in Status: SUCCESS [ 755.447541] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 deletion is rescheduled due to dependency. [ 755.447592] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.452608] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0db36d0-bbf1-4643-8661-68a84fdee418',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.905517] env[69491]: INFO networking_nsxv3.common.synchronization [req-97ab8694-6981-462b-8817-c45b745da3c3 req-2277f7e1-cfe6-4f0b-bdf3-c4c1ac891e31 tempest-AttachInterfacesUnderV243Test-1007658330 tempest-AttachInterfacesUnderV243Test-1007658330-project-member] Enqueued Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 755.905517] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 755.905517] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.905517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.905517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.905880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.905964] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.906067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.906143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.906308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.906387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.908090] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.957437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.957642] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.957719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.958035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.958134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.958256] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0db36d0-bbf1-4643-8661-68a84fdee418 is going to be created. [ 755.996213] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.996384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.996471] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.998023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.998023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.010802] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0db36d0-bbf1-4643-8661-68a84fdee418 in Status: UNINITIALIZED for 2s [ 756.253261] env[69491]: INFO networking_nsxv3.common.synchronization [req-76df6f09-a611-4dc0-b953-3c2c5e069470 req-23c65e3e-cd47-40a7-84c7-4388a373e782 tempest-ServerGroupTestJSON-1027954235 tempest-ServerGroupTestJSON-1027954235-project-member] Enqueued Resource ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 with Priority: HIGHEST for action security_group_members [ 756.253261] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 with Priority: HIGHEST for action security_group_members [ 756.253945] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72c0d6b-219d-45d0-992a-5e67f5d6c827 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.254278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.254448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.254785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.255198] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.255445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.255616] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.255917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.256200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.256729] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d72c0d6b-219d-45d0-992a-5e67f5d6c827',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.353128] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-936 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.353128] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-936" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.353593] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-936" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.353860] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-936" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.354278] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.354479] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.354606] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.354913] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.355327] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.355487] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 756.355625] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 756.355743] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 756.355921] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 756.356097] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 756.356226] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 756.356383] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 756.385202] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 756.385372] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 756.385511] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 756.385692] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-936" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.386015] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.386201] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.386349] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.386708] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.386853] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d188c80-ea15-4a49-ab8a-07ad0c42cbda',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.408317] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.408604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.408800] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.409108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.409385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.409622] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.409831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.409946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.410181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.410272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.410434] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0b71710-cca2-4c0f-bcce-171044129d44 already deleted. [ 756.410606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.762337] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.762337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.762337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.762841] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.762841] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.762902] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.762949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.763028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.763193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.763271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.763384] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 is going to be updated. [ 756.797392] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.797657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.797720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.797994] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.798348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.812073] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 in Status: IN_PROGRESS for 2s [ 756.889681] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.889958] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.890130] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.890439] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.890588] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.890853] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 6d188c80-ea15-4a49-ab8a-07ad0c42cbda not found, creating... [ 756.891167] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.891800] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.891800] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.891800] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.891962] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.892255] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.892429] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.892555] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.892791] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.892956] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.893120] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 6d188c80-ea15-4a49-ab8a-07ad0c42cbda is going to be created. [ 756.919596] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.919869] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.919988] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.920537] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.920537] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.920733] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.834397] env[69491]: INFO networking_nsxv3.common.synchronization [req-97ab8694-6981-462b-8817-c45b745da3c3 req-b4a66662-53eb-490b-8c08-df4839e3af46 service nova] Enqueued Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_rules [ 757.834679] env[69491]: INFO networking_nsxv3.common.synchronization [req-97ab8694-6981-462b-8817-c45b745da3c3 req-b4a66662-53eb-490b-8c08-df4839e3af46 service nova] Enqueued Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 757.834772] env[69491]: INFO networking_nsxv3.common.synchronization [req-97ab8694-6981-462b-8817-c45b745da3c3 req-b4a66662-53eb-490b-8c08-df4839e3af46 service nova] Enqueued Resource ID: 6d188c80-ea15-4a49-ab8a-07ad0c42cbda with Priority: HIGHEST for action port [ 757.834958] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_rules [ 757.835102] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 757.835203] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d188c80-ea15-4a49-ab8a-07ad0c42cbda with Priority: HIGHEST for action port [ 757.835802] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.835938] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.836007] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.839472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.839614] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.840624] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.840748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.844036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.844036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.844036] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.844036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.844036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.844036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.844036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.844036] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.844036] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.844036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.844036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.844036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.844036] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d188c80-ea15-4a49-ab8a-07ad0c42cbda',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.896500] env[69491]: INFO networking_nsxv3.common.synchronization [req-f8dc3f0d-463b-406a-a673-c5d9138eeb65 req-090ed32d-27eb-478f-a0e3-61e8c94182f4 tempest-ListServersNegativeTestJSON-1336340583 tempest-ListServersNegativeTestJSON-1336340583-project-member] Enqueued Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 757.897869] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 757.898345] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.898481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.898548] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.898864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.899110] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.899252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.899324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.899494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.899591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.899703] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.945581] env[69491]: INFO networking_nsxv3.common.synchronization [req-bec9e756-1ae1-4808-b48b-1c062e081a43 req-ec805fe5-998f-40d4-a420-a8971b76a720 tempest-ListServersNegativeTestJSON-1336340583 tempest-ListServersNegativeTestJSON-1336340583-project-member] Enqueued Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 757.946242] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 with Priority: HIGHEST for action security_group_members [ 757.949019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.949019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.024226] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0db36d0-bbf1-4643-8661-68a84fdee418 in Status: SUCCESS [ 758.024498] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.025143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.025426] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.025661] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.025808] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.025902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.026110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.026235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.026360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.026478] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0db36d0-bbf1-4643-8661-68a84fdee418',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.346043] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.350284] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.350284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.351352] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d188c80-ea15-4a49-ab8a-07ad0c42cbda with status ACTIVE [ 758.351629] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.351776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.351834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.352289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.352289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.352382] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.352520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.352603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.353754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.353754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.353754] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.353754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.353754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.353754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.353754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.353754] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d188c80-ea15-4a49-ab8a-07ad0c42cbda is going to be updated. [ 758.380166] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.380640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.380640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.380859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.381114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.381369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.402758] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.402872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.402941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.403201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.403308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.403533] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.403622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.403680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.403827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.403876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.403962] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 is going to be updated. [ 758.462046] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.462046] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.462275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.462390] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.462587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.488164] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: IN_PROGRESS for 2s [ 758.532240] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0db36d0-bbf1-4643-8661-68a84fdee418 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.532415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.532490] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.532775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.532988] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.533118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.533777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.533777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.533777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.533777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.534024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0db36d0-bbf1-4643-8661-68a84fdee418 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.534024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.534158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.534297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.534430] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.534533] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.534589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.534751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.534851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.534956] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.535564] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0db36d0-bbf1-4643-8661-68a84fdee418',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.827087] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 in Status: SUCCESS [ 758.827427] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 deletion is rescheduled due to dependency. [ 758.827576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.848525] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.039867] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0db36d0-bbf1-4643-8661-68a84fdee418: rpc.has_security_group_logging(os_id): False [ 759.066861] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.067329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.068710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.068710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.068710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.068710] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.068710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.068710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.068710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.069193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.069514] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.069733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.069881] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.070131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.070322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.070628] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.071113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.071298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.071566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.071764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.071960] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0db36d0-bbf1-4643-8661-68a84fdee418 is going to be created. [ 759.143035] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.143035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.143035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.143035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.143035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.155821] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0db36d0-bbf1-4643-8661-68a84fdee418 in Status: IN_PROGRESS for 2s [ 759.351921] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.355362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.355362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.355362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.355362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.355362] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0b71710-cca2-4c0f-bcce-171044129d44 is going to be created. [ 759.414430] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.414430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.414430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.414430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.414430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.425619] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0b71710-cca2-4c0f-bcce-171044129d44 in Status: UNINITIALIZED for 2s [ 760.503344] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: SUCCESS [ 760.503344] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 deletion is rescheduled due to dependency. [ 760.503344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.503714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.503843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.504128] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.504323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.504438] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.504682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.504808] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.504938] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f6ef41a-5e03-4f6b-8b59-b1f729f165d1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.007168] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.010965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.010965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.010965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.010965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.010965] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.010965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.010965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.010965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.010965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.010965] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 is going to be updated. [ 761.041484] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.041663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.041705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.041925] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.042068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.055420] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: IN_PROGRESS for 2s [ 761.176516] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0db36d0-bbf1-4643-8661-68a84fdee418 in Status: SUCCESS [ 761.176811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.231550] env[69491]: INFO networking_nsxv3.common.synchronization [req-87f34709-730f-4999-9550-20da135e7736 req-2f4ba764-24ff-4689-86a2-accf221a98d9 tempest-VolumesAdminNegativeTest-1366311223 tempest-VolumesAdminNegativeTest-1366311223-project-member] Enqueued Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGHEST for action security_group_members [ 761.235577] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGHEST for action security_group_members [ 761.236454] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4084412-2aca-4bc0-a15c-1690668e51ea taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.236560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.236633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.236947] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.237081] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.237188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.237311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.237439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.237494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.237693] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.442322] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0b71710-cca2-4c0f-bcce-171044129d44 in Status: SUCCESS [ 761.442568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.442747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.443839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.443839] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.443839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.443839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.443839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.443839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.443839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.443839] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.743058] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.743455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.743455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.743524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.743554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.743805] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.743870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.743932] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.744083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.744163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.744248] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4084412-2aca-4bc0-a15c-1690668e51ea already deleted. [ 761.744327] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.946730] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.025959] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-77 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.026314] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-77" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.026314] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-77" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.028841] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-77" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.029210] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.029391] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.029520] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.029878] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.029945] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.030747] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.030747] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.030956] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.031124] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.031253] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.031366] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.031503] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.053257] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.053498] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 762.053652] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.053835] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-77" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.054187] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-45237790-d30d-41c3-ac35-66a6f519487b taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.054365] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-45237790-d30d-41c3-ac35-66a6f519487b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.054489] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-45237790-d30d-41c3-ac35-66a6f519487b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.054835] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-45237790-d30d-41c3-ac35-66a6f519487b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.054979] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45237790-d30d-41c3-ac35-66a6f519487b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.198994] env[69491]: INFO networking_nsxv3.common.synchronization [None req-1fc6735f-1b30-4499-b094-5acc8ba36e8c None None] Enqueued Resource ID: 0e6bc959-5077-4ae9-92fa-496c2856c26e with Priority: HIGHEST for action port [ 762.199627] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e6bc959-5077-4ae9-92fa-496c2856c26e with Priority: HIGHEST for action port [ 762.200204] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e6bc959-5077-4ae9-92fa-496c2856c26e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.200576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e6bc959-5077-4ae9-92fa-496c2856c26e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.200672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e6bc959-5077-4ae9-92fa-496c2856c26e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.201172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e6bc959-5077-4ae9-92fa-496c2856c26e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.201573] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e6bc959-5077-4ae9-92fa-496c2856c26e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.449271] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0b71710-cca2-4c0f-bcce-171044129d44: rpc.has_security_group_logging(os_id): False [ 762.471439] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.474028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.474028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.474028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.474028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.474028] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.474028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.474028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.474028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.474028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.474028] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0b71710-cca2-4c0f-bcce-171044129d44 is going to be created. [ 762.557896] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.557896] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.557896] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.558173] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.558324] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.558552] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 45237790-d30d-41c3-ac35-66a6f519487b not found, creating... [ 762.558957] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.559147] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.559263] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.559495] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.559852] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.560012] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.560361] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.564036] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.564036] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.564036] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.564036] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 45237790-d30d-41c3-ac35-66a6f519487b is going to be created. [ 762.564036] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.564036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.564036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.564036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.564036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.579480] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0b71710-cca2-4c0f-bcce-171044129d44 in Status: IN_PROGRESS for 2s [ 762.604554] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.606061] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.606308] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.606640] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.606951] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.607240] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-45237790-d30d-41c3-ac35-66a6f519487b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.704793] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e6bc959-5077-4ae9-92fa-496c2856c26e [ 762.704793] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.704793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.704793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.704793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.704793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.706056] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e6bc959-5077-4ae9-92fa-496c2856c26e already deleted. [ 762.706056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e6bc959-5077-4ae9-92fa-496c2856c26e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.068968] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 in Status: SUCCESS [ 763.069321] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f6ef41a-5e03-4f6b-8b59-b1f729f165d1 deletion is rescheduled due to dependency. [ 763.069321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f6ef41a-5e03-4f6b-8b59-b1f729f165d1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.649040] env[69491]: INFO networking_nsxv3.common.synchronization [req-87f34709-730f-4999-9550-20da135e7736 req-229ee820-c0a1-4f71-9737-27a45677328a service nova] Enqueued Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGHEST for action security_group_rules [ 763.652202] env[69491]: INFO networking_nsxv3.common.synchronization [req-87f34709-730f-4999-9550-20da135e7736 req-229ee820-c0a1-4f71-9737-27a45677328a service nova] Enqueued Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGHEST for action security_group_members [ 763.652202] env[69491]: INFO networking_nsxv3.common.synchronization [req-87f34709-730f-4999-9550-20da135e7736 req-229ee820-c0a1-4f71-9737-27a45677328a service nova] Enqueued Resource ID: 45237790-d30d-41c3-ac35-66a6f519487b with Priority: HIGHEST for action port [ 763.652202] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGHEST for action security_group_rules [ 763.652202] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGHEST for action security_group_members [ 763.652202] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45237790-d30d-41c3-ac35-66a6f519487b with Priority: HIGHEST for action port [ 763.652202] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4084412-2aca-4bc0-a15c-1690668e51ea taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.652202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.652202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.652202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.652202] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.655534] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4084412-2aca-4bc0-a15c-1690668e51ea taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.655534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.655534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.655534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.655534] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.655534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.655534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.655534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.655534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.655534] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.655534] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-45237790-d30d-41c3-ac35-66a6f519487b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.655534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45237790-d30d-41c3-ac35-66a6f519487b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.655534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45237790-d30d-41c3-ac35-66a6f519487b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.655534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45237790-d30d-41c3-ac35-66a6f519487b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.655534] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45237790-d30d-41c3-ac35-66a6f519487b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.153983] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4084412-2aca-4bc0-a15c-1690668e51ea taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.154295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.155642] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.158373] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45237790-d30d-41c3-ac35-66a6f519487b with status ACTIVE [ 764.159125] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.159261] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.160453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.160453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.160453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.160453] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.160453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.160453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.160453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.160679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.160756] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.165022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.165022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.165022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.165022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.165022] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45237790-d30d-41c3-ac35-66a6f519487b is going to be updated. [ 764.192265] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.192658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.192658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.193890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.194085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.194319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45237790-d30d-41c3-ac35-66a6f519487b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.602210] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0b71710-cca2-4c0f-bcce-171044129d44 in Status: SUCCESS [ 764.614513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.664943] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.874409] env[69491]: INFO networking_nsxv3.common.synchronization [None req-ed69ecc6-a25d-42e9-af20-6e241e8bf3f8 None None] Enqueued Resource ID: 534af9d2-b39e-4fee-a6bb-98876f1d6da7 with Priority: HIGHEST for action port [ 764.874679] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 534af9d2-b39e-4fee-a6bb-98876f1d6da7 with Priority: HIGHEST for action port [ 764.875337] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-534af9d2-b39e-4fee-a6bb-98876f1d6da7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.875401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-534af9d2-b39e-4fee-a6bb-98876f1d6da7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.875461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-534af9d2-b39e-4fee-a6bb-98876f1d6da7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.875713] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-534af9d2-b39e-4fee-a6bb-98876f1d6da7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.875801] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('534af9d2-b39e-4fee-a6bb-98876f1d6da7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.898871] env[69491]: INFO networking_nsxv3.common.synchronization [None req-c74233dd-da6b-498b-8b09-fe07ea51cc78 None None] Enqueued Resource ID: da5627a6-a2e2-4d59-b862-815c9470f1a3 with Priority: HIGHEST for action port [ 764.899167] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da5627a6-a2e2-4d59-b862-815c9470f1a3 with Priority: HIGHEST for action port [ 764.899800] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-da5627a6-a2e2-4d59-b862-815c9470f1a3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.899933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da5627a6-a2e2-4d59-b862-815c9470f1a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.900015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da5627a6-a2e2-4d59-b862-815c9470f1a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.900284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da5627a6-a2e2-4d59-b862-815c9470f1a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.900368] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da5627a6-a2e2-4d59-b862-815c9470f1a3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.169148] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.169515] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.169515] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.169593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.169685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.169785] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4084412-2aca-4bc0-a15c-1690668e51ea is going to be created. [ 765.200205] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.200306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.200360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.200561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.200719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.211697] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4084412-2aca-4bc0-a15c-1690668e51ea in Status: UNINITIALIZED for 2s [ 765.378402] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 534af9d2-b39e-4fee-a6bb-98876f1d6da7 [ 765.378649] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.378818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.378858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.379186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.379271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.379323] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:534af9d2-b39e-4fee-a6bb-98876f1d6da7 already deleted. [ 765.383024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-534af9d2-b39e-4fee-a6bb-98876f1d6da7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.407919] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da5627a6-a2e2-4d59-b862-815c9470f1a3 [ 765.408154] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.408296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.408367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.408622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.408671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.408753] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da5627a6-a2e2-4d59-b862-815c9470f1a3 already deleted. [ 765.408835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da5627a6-a2e2-4d59-b862-815c9470f1a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.349485] env[69491]: INFO networking_nsxv3.common.synchronization [None req-e97a90e0-72ac-42c8-8e1c-a7733acb413c None None] Enqueued Resource ID: 71c63c75-1c7a-4d9a-86ae-7b4d8e86e535 with Priority: HIGHEST for action port [ 766.349776] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71c63c75-1c7a-4d9a-86ae-7b4d8e86e535 with Priority: HIGHEST for action port [ 766.351162] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-71c63c75-1c7a-4d9a-86ae-7b4d8e86e535 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.351162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71c63c75-1c7a-4d9a-86ae-7b4d8e86e535" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.351162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71c63c75-1c7a-4d9a-86ae-7b4d8e86e535" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.351162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71c63c75-1c7a-4d9a-86ae-7b4d8e86e535" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.351162] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71c63c75-1c7a-4d9a-86ae-7b4d8e86e535',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.779075] env[69491]: INFO networking_nsxv3.common.synchronization [None req-9fc2428f-67a2-4d24-a781-f41bfed3a97b tempest-AttachVolumeTestJSON-1247015010 tempest-AttachVolumeTestJSON-1247015010-project-member] Enqueued Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGHEST for action security_group_rules [ 766.779619] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGHEST for action security_group_rules [ 766.779955] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-556224b2-1959-4315-89ac-879f1d706247 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.780100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.780165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.780410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.780488] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('556224b2-1959-4315-89ac-879f1d706247',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.853150] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71c63c75-1c7a-4d9a-86ae-7b4d8e86e535 [ 766.853381] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.853509] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.853610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.853781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.853866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.853959] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71c63c75-1c7a-4d9a-86ae-7b4d8e86e535 already deleted. [ 766.854051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71c63c75-1c7a-4d9a-86ae-7b4d8e86e535" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.929277] env[69491]: INFO networking_nsxv3.common.synchronization [None req-4413cac9-6dae-45cc-b422-03c40fb73c36 tempest-AttachVolumeTestJSON-1247015010 tempest-AttachVolumeTestJSON-1247015010-project-member] Enqueued Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGHEST for action security_group_rules [ 766.929322] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGHEST for action security_group_rules [ 766.929706] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-556224b2-1959-4315-89ac-879f1d706247 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.929803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.147735] env[69491]: INFO networking_nsxv3.common.synchronization [None req-17131eca-b172-4958-a2a0-3632dd074cc3 tempest-MigrationsAdminTest-1576792364 tempest-MigrationsAdminTest-1576792364-project-member] Enqueued Resource ID: abfc6e21-8814-4950-b95d-403467fc52d4 with Priority: HIGHEST for action security_group_rules [ 767.149842] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abfc6e21-8814-4950-b95d-403467fc52d4 with Priority: HIGHEST for action security_group_rules [ 767.149842] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abfc6e21-8814-4950-b95d-403467fc52d4 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.150045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abfc6e21-8814-4950-b95d-403467fc52d4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.150141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abfc6e21-8814-4950-b95d-403467fc52d4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.150406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abfc6e21-8814-4950-b95d-403467fc52d4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.150489] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abfc6e21-8814-4950-b95d-403467fc52d4',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.226383] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4084412-2aca-4bc0-a15c-1690668e51ea in Status: SUCCESS [ 767.226701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.227096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.227458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.227684] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.227819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.227886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.228091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.228186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.228283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.228377] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.305508] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.305657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.305727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.306458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.306458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.306458] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 556224b2-1959-4315-89ac-879f1d706247 already deleted. [ 767.306458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.306458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.306651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.306651] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('556224b2-1959-4315-89ac-879f1d706247',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.334577] env[69491]: INFO networking_nsxv3.common.synchronization [None req-95a8b4e1-e93d-42ba-ada4-3d6614b7ef52 tempest-MigrationsAdminTest-1576792364 tempest-MigrationsAdminTest-1576792364-project-member] Enqueued Resource ID: abfc6e21-8814-4950-b95d-403467fc52d4 with Priority: HIGHEST for action security_group_rules [ 767.337970] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abfc6e21-8814-4950-b95d-403467fc52d4 with Priority: HIGHEST for action security_group_rules [ 767.337970] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abfc6e21-8814-4950-b95d-403467fc52d4 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.337970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abfc6e21-8814-4950-b95d-403467fc52d4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.465756] env[69491]: INFO networking_nsxv3.common.synchronization [None req-23153bae-0f40-418e-b370-da31cbebaf7b None None] Enqueued Resource ID: d5f113e5-2197-4e71-9590-12e7b281361c with Priority: HIGHEST for action port [ 767.466349] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5f113e5-2197-4e71-9590-12e7b281361c with Priority: HIGHEST for action port [ 767.466678] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5f113e5-2197-4e71-9590-12e7b281361c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.466811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5f113e5-2197-4e71-9590-12e7b281361c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.466873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5f113e5-2197-4e71-9590-12e7b281361c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.468374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5f113e5-2197-4e71-9590-12e7b281361c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.468374] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5f113e5-2197-4e71-9590-12e7b281361c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.735442] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.801760] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.801910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.801995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.802269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.802364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.802472] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abfc6e21-8814-4950-b95d-403467fc52d4 already deleted. [ 767.802615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abfc6e21-8814-4950-b95d-403467fc52d4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.802857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abfc6e21-8814-4950-b95d-403467fc52d4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.804747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abfc6e21-8814-4950-b95d-403467fc52d4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.804747] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abfc6e21-8814-4950-b95d-403467fc52d4',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.843051] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.843245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.843245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.843420] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.843506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.843600] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 556224b2-1959-4315-89ac-879f1d706247 already deleted. [ 767.843681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.971417] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5f113e5-2197-4e71-9590-12e7b281361c [ 767.971417] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.971417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.971417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.971417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.971417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.971417] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5f113e5-2197-4e71-9590-12e7b281361c already deleted. [ 767.971417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5f113e5-2197-4e71-9590-12e7b281361c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.241050] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4084412-2aca-4bc0-a15c-1690668e51ea: rpc.has_security_group_logging(os_id): False [ 768.267598] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.271033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.271033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.271033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.271033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.271033] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.271033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.271033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.271033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.271033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.271033] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4084412-2aca-4bc0-a15c-1690668e51ea is going to be created. [ 768.330281] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.330281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.330281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.330281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.330281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.330281] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abfc6e21-8814-4950-b95d-403467fc52d4 already deleted. [ 768.330281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abfc6e21-8814-4950-b95d-403467fc52d4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.332954] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.333146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.333196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.333375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.333553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.341158] env[69491]: INFO networking_nsxv3.common.synchronization [req-31f65572-d8a3-4bee-96f7-e7b4d82dfa04 req-51cd26fe-822f-44d5-b49b-e11ae31af5ff tempest-ImagesTestJSON-1178517317 tempest-ImagesTestJSON-1178517317-project-member] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 768.341158] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 768.341158] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.341158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.341158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.341690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.341968] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.342215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.342379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.342658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.342880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.343087] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.349092] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4084412-2aca-4bc0-a15c-1690668e51ea in Status: IN_PROGRESS for 2s [ 768.710112] env[69491]: INFO networking_nsxv3.common.synchronization [None req-1a18fa3e-03a1-4301-9532-99c6595f0ed4 None None] Enqueued Resource ID: 4bf0fcd3-6f9e-48ca-a2a1-807949ca50a6 with Priority: HIGHEST for action port [ 768.710112] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf0fcd3-6f9e-48ca-a2a1-807949ca50a6 with Priority: HIGHEST for action port [ 768.711013] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bf0fcd3-6f9e-48ca-a2a1-807949ca50a6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.711319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bf0fcd3-6f9e-48ca-a2a1-807949ca50a6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.711474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bf0fcd3-6f9e-48ca-a2a1-807949ca50a6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.711807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bf0fcd3-6f9e-48ca-a2a1-807949ca50a6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.711996] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bf0fcd3-6f9e-48ca-a2a1-807949ca50a6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.848181] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.848181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.848181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.848181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.848181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.848181] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.848181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.848181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.848181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.848181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.848181] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 768.879272] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.882727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.882727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.882727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.882727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.891526] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 769.013031] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.013031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.013031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.013031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.013031] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.014164] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.014164] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.016031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.016031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.016031] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 769.016031] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 769.016031] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 769.016031] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 769.016473] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 769.016681] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 769.017020] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 769.038028] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 769.038240] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 769.038412] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 769.038601] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.039011] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-5487f5a0-536d-47da-9635-e3dff79a595b taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.039208] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-5487f5a0-536d-47da-9635-e3dff79a595b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.039365] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-5487f5a0-536d-47da-9635-e3dff79a595b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.039785] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-5487f5a0-536d-47da-9635-e3dff79a595b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.039956] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5487f5a0-536d-47da-9635-e3dff79a595b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.215200] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bf0fcd3-6f9e-48ca-a2a1-807949ca50a6 [ 769.215200] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.215200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.215200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.215200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.215200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.215200] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4bf0fcd3-6f9e-48ca-a2a1-807949ca50a6 already deleted. [ 769.215200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bf0fcd3-6f9e-48ca-a2a1-807949ca50a6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.543553] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.543788] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.543914] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.544238] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.544386] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.544542] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 5487f5a0-536d-47da-9635-e3dff79a595b not found, creating... [ 769.544810] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.544968] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.545120] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.545425] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.545568] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.545864] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.546245] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.546438] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.546666] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.546804] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.546976] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 5487f5a0-536d-47da-9635-e3dff79a595b is going to be created. [ 769.581106] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.581106] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.581106] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.581106] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.581106] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.581106] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-5487f5a0-536d-47da-9635-e3dff79a595b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.805356] env[69491]: INFO networking_nsxv3.common.synchronization [req-c530ca0e-8891-4ecd-b329-a6a8dd4a3504 req-5a744ad0-d738-4d56-9b22-0cff88b9c745 tempest-InstanceActionsV221TestJSON-1582933430 tempest-InstanceActionsV221TestJSON-1582933430-project-member] Enqueued Resource ID: f0db36d0-bbf1-4643-8661-68a84fdee418 with Priority: HIGHEST for action security_group_members [ 769.805905] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0db36d0-bbf1-4643-8661-68a84fdee418 with Priority: HIGHEST for action security_group_members [ 769.806227] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0db36d0-bbf1-4643-8661-68a84fdee418 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.806347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.806414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.807137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.807137] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.807137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.807137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.807409] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.807409] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.807518] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0db36d0-bbf1-4643-8661-68a84fdee418',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.312587] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.312587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.312587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.312587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.312587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.312587] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.312587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.312587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.312587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.312587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.312587] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0db36d0-bbf1-4643-8661-68a84fdee418 is going to be updated. [ 770.351786] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.351786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.351786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.351786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.351786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.365772] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0db36d0-bbf1-4643-8661-68a84fdee418 in Status: IN_PROGRESS for 2s [ 770.367216] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4084412-2aca-4bc0-a15c-1690668e51ea in Status: SUCCESS [ 770.369412] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.476267] env[69491]: INFO networking_nsxv3.common.synchronization [req-31f65572-d8a3-4bee-96f7-e7b4d82dfa04 req-d43540fc-5b2f-453d-81cf-6d97fb1141c9 service nova] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_rules [ 770.476466] env[69491]: INFO networking_nsxv3.common.synchronization [req-31f65572-d8a3-4bee-96f7-e7b4d82dfa04 req-d43540fc-5b2f-453d-81cf-6d97fb1141c9 service nova] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 770.476604] env[69491]: INFO networking_nsxv3.common.synchronization [req-31f65572-d8a3-4bee-96f7-e7b4d82dfa04 req-d43540fc-5b2f-453d-81cf-6d97fb1141c9 service nova] Enqueued Resource ID: 5487f5a0-536d-47da-9635-e3dff79a595b with Priority: HIGHEST for action port [ 770.476838] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_rules [ 770.476968] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 770.477101] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5487f5a0-536d-47da-9635-e3dff79a595b with Priority: HIGHEST for action port [ 770.478569] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.478704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.478775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.479057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.479111] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.480591] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.480591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.485812] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-5487f5a0-536d-47da-9635-e3dff79a595b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.485812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5487f5a0-536d-47da-9635-e3dff79a595b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.485812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5487f5a0-536d-47da-9635-e3dff79a595b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.485812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5487f5a0-536d-47da-9635-e3dff79a595b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.486062] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5487f5a0-536d-47da-9635-e3dff79a595b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.903085] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 770.903418] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 deletion is rescheduled due to dependency. [ 770.904153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.904153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.904153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.904466] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.904544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.905480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.905480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.905480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.905480] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.991022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.991022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.991022] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5487f5a0-536d-47da-9635-e3dff79a595b with status ACTIVE [ 770.991022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.991022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.991022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.991022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.991022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.991022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.991022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.991022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.991022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.991022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.991022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.992013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.992013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.992013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.992013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.992013] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5487f5a0-536d-47da-9635-e3dff79a595b is going to be updated. [ 771.027965] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.028189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.028189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.028455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.028551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.028724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5487f5a0-536d-47da-9635-e3dff79a595b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.331197] env[69491]: INFO networking_nsxv3.common.synchronization [req-c2f900c2-c50e-4214-853c-6a4d68bb42af req-a3b86039-4a03-44ad-b9d4-dc91c8485c7f tempest-ServersNegativeTestJSON-337259715 tempest-ServersNegativeTestJSON-337259715-project-member] Enqueued Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 771.331866] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 771.332064] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.336424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.336424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.336711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.336905] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.337049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.337117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.337290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.337376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.337458] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.375254] env[69491]: INFO networking_nsxv3.common.synchronization [None req-9a83b745-31b3-4dd6-9c3a-ea0727b21a46 tempest-ServerRescueNegativeTestJSON-1517573171 tempest-ServerRescueNegativeTestJSON-1517573171-project-member] Enqueued Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGHEST for action security_group_rules [ 771.375572] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGHEST for action security_group_rules [ 771.376182] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdef2989-64ee-40c2-bd6c-f47c52643b88 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.376317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.376407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.376647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.376729] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdef2989-64ee-40c2-bd6c-f47c52643b88',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.413508] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.459150] env[69491]: INFO networking_nsxv3.common.synchronization [None req-9e3e7706-0a0f-41a3-b060-2919e57d089b tempest-ServerRescueNegativeTestJSON-1517573171 tempest-ServerRescueNegativeTestJSON-1517573171-project-member] Enqueued Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGHEST for action security_group_rules [ 771.459672] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGHEST for action security_group_rules [ 771.460149] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdef2989-64ee-40c2-bd6c-f47c52643b88 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.460149] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.839959] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.840511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.840592] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.840821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.840914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.841405] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.841557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.841626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.841793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.841874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.841967] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 already deleted. [ 771.842057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.900048] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.900304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.900304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.900479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.900518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.900620] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 already deleted. [ 771.900702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.900858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.901022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.901104] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdef2989-64ee-40c2-bd6c-f47c52643b88',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.916896] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.242134] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-922 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.242382] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-922" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.242527] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-922" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.242847] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-922" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.243127] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.243286] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.243403] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.243740] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.243800] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.243960] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 772.244615] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 772.244944] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 772.245246] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 772.245675] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 772.246011] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 772.247168] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 772.272999] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 772.273346] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 772.273570] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 772.273848] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-922" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.274563] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-64bb0326-dc96-4647-9145-fe361fbed7fe taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.274890] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.275093] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.275508] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.275663] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64bb0326-dc96-4647-9145-fe361fbed7fe',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.380313] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0db36d0-bbf1-4643-8661-68a84fdee418 in Status: SUCCESS [ 772.380502] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0db36d0-bbf1-4643-8661-68a84fdee418 deletion is rescheduled due to dependency. [ 772.380620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.419797] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.420097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.420238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.420563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.420711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.420873] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 772.430925] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.431103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.431452] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.431741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.431852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.431956] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 already deleted. [ 772.432068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.458745] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.459185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.459185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.459351] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.459756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.474223] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 772.583276] env[69491]: INFO networking_nsxv3.common.synchronization [req-3b360f31-9e9d-498c-908f-8999a4ab911d req-25e6546c-15e2-432d-8de2-18d863ff3f9e tempest-ServersAdminNegativeTestJSON-1852575205 tempest-ServersAdminNegativeTestJSON-1852575205-project-member] Enqueued Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_members [ 772.583276] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_members [ 772.583276] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.583417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.583417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.583589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.583749] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.583863] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.583927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.584131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.584222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.586069] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.779526] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.780066] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.780247] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.780525] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.780714] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.780901] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 64bb0326-dc96-4647-9145-fe361fbed7fe not found, creating... [ 772.781225] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.781419] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.781567] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.781828] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.782035] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.782846] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.782846] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.782846] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.783233] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.783233] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.783570] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 64bb0326-dc96-4647-9145-fe361fbed7fe is going to be created. [ 772.805684] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.806249] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.806420] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.806751] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.807051] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.807322] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.090682] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.594274] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.713612] env[69491]: INFO networking_nsxv3.common.synchronization [req-c2f900c2-c50e-4214-853c-6a4d68bb42af req-6b5ce8bc-ca83-49f4-884c-040b8e4f4c94 service nova] Enqueued Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_rules [ 773.713788] env[69491]: INFO networking_nsxv3.common.synchronization [req-c2f900c2-c50e-4214-853c-6a4d68bb42af req-6b5ce8bc-ca83-49f4-884c-040b8e4f4c94 service nova] Enqueued Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 773.713924] env[69491]: INFO networking_nsxv3.common.synchronization [req-c2f900c2-c50e-4214-853c-6a4d68bb42af req-6b5ce8bc-ca83-49f4-884c-040b8e4f4c94 service nova] Enqueued Resource ID: 64bb0326-dc96-4647-9145-fe361fbed7fe with Priority: HIGHEST for action port [ 773.714170] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_rules [ 773.714292] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 773.714382] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64bb0326-dc96-4647-9145-fe361fbed7fe with Priority: HIGHEST for action port [ 773.714950] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.717180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.717266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.717559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.717625] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.719579] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.719579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.719579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.719579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.719579] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.719579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.719579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.719871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.719871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.719871] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.721144] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-64bb0326-dc96-4647-9145-fe361fbed7fe taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.721144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.721144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.721144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.721144] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64bb0326-dc96-4647-9145-fe361fbed7fe',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.101096] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.101508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.101508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.101672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.101672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.101782] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 is going to be updated. [ 774.134173] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.134422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.134422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.134599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.134736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.144632] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: IN_PROGRESS for 2s [ 774.223558] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.224745] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.224872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.225157] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64bb0326-dc96-4647-9145-fe361fbed7fe with status ACTIVE [ 774.225570] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.225570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.225570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.225790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.225790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.225977] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.226122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.226207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.227055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.227055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.227055] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.227055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.227055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.227055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.227055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.227459] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64bb0326-dc96-4647-9145-fe361fbed7fe is going to be updated. [ 774.266190] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.266190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.266952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.266952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.267102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.267311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.485919] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 774.486734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.486734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.486734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.486734] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.486893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.486936] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.487547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.487547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.487547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.487547] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.729854] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.994011] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.994244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.994369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.994686] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.994944] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.995095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.995185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.995365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.995457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.995588] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.995758] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.995868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.995937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.996116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.996278] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.996385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.996460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.996635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.996728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.996835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.996961] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.236431] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.236431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.236431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.236431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.236431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.236431] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 is going to be created. [ 775.263973] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.264198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.264246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.264482] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.264693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.286997] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: UNINITIALIZED for 2s [ 775.500672] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9028d23d-9b03-48da-a060-d720486e9412: rpc.has_security_group_logging(os_id): False [ 775.520571] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.520571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.520571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.520799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.520917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.521474] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.521638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.521788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.521946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.522057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.522318] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.522465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.522539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.522720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.522840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.523041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.523140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.523239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.523385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.523450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.523585] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 775.591965] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.592108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.592196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.592415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.592578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.608763] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 776.160631] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: IN_PROGRESS for 4s [ 776.528914] env[69491]: INFO networking_nsxv3.common.synchronization [None req-06552e49-6222-4204-9155-6118fc21c05e tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGHEST for action security_group_rules [ 776.530553] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGHEST for action security_group_rules [ 776.531075] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.531302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.531440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.531789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.532118] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab8f0b03-5851-4bc3-a9e8-aba2b5714126',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.788738] env[69491]: INFO networking_nsxv3.common.synchronization [None req-d0fc8879-34de-40a1-b486-20d84930094b tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGHEST for action security_group_rules [ 776.789465] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGHEST for action security_group_rules [ 776.789788] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.789895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.058281] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.058494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.058494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.058737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.058826] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.058919] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 already deleted. [ 777.059010] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.059175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.059362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.059450] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab8f0b03-5851-4bc3-a9e8-aba2b5714126',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.298346] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: SUCCESS [ 777.298486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.298558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.298782] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.298987] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.299130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.299237] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.299439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.299649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.299649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.299783] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.581165] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.581165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.581165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.581165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.581165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.581165] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 already deleted. [ 777.581165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.625637] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 777.625864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.803505] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.803690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.803764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.803997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.804195] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.804303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.804365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.804508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.804595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.804683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.804828] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.804923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.804983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.805136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.805273] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.805365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.805425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.805559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.805631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.805709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.805802] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.172369] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: SUCCESS [ 778.172524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.313011] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fafd77cc-d50d-41af-b588-6629e9cea514: rpc.has_security_group_logging(os_id): False [ 778.344210] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.344375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.344418] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.345198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.346046] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.346046] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.346210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.346249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.346435] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.346519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.346747] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.346900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.346900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.347311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.347413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.347610] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.347706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.347767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.347922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.348027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.348382] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 is going to be created. [ 778.471598] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.471808] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.471808] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.472155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.472308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.495092] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: IN_PROGRESS for 2s [ 778.670222] env[69491]: INFO networking_nsxv3.common.synchronization [req-3463e601-933c-40e5-9b7e-b97ee5b4b5c8 req-24f69982-d448-418d-a814-31b7ec03c6d6 tempest-ServersTestBootFromVolume-1969005607 tempest-ServersTestBootFromVolume-1969005607-project-member] Enqueued Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGHEST for action security_group_members [ 778.670808] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGHEST for action security_group_members [ 778.672774] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4976ed-85d7-4836-b6cb-a96b2293c655 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.672937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.673126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.673346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.673564] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.673675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.673736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.673899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.673981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.674088] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.177952] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.177952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.177952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.177952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.177952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.177952] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.177952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.177952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.177952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.177952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.177952] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de4976ed-85d7-4836-b6cb-a96b2293c655 already deleted. [ 779.184295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.190582] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-342 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.190784] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-342" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.190915] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-342" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.191273] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-342" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.191537] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.191701] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.191889] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.192048] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.192193] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.192440] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.193022] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.193022] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.193022] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.193022] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.193205] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.193205] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.215934] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.217040] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.217040] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.217040] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-342" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.217040] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-40f47d40-2abf-47c7-9f1a-9e1baf0100aa taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.217040] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-40f47d40-2abf-47c7-9f1a-9e1baf0100aa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.217305] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-40f47d40-2abf-47c7-9f1a-9e1baf0100aa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.217463] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-40f47d40-2abf-47c7-9f1a-9e1baf0100aa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.217604] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40f47d40-2abf-47c7-9f1a-9e1baf0100aa',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.720916] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.721767] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.721767] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.722299] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.722299] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.722299] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 40f47d40-2abf-47c7-9f1a-9e1baf0100aa not found, creating... [ 779.722429] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.722644] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.722644] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.722997] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.722997] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.724375] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.724375] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.724375] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.724375] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.724375] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.725331] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 40f47d40-2abf-47c7-9f1a-9e1baf0100aa is going to be created. [ 779.763008] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.766978] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.767208] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.767525] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.767780] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.769670] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-40f47d40-2abf-47c7-9f1a-9e1baf0100aa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.510467] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: SUCCESS [ 780.512819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.760321] env[69491]: INFO networking_nsxv3.common.synchronization [req-3463e601-933c-40e5-9b7e-b97ee5b4b5c8 req-2c874c1d-9a7c-43bc-bd63-98c37f1c58b6 service nova] Enqueued Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGHEST for action security_group_rules [ 780.760657] env[69491]: INFO networking_nsxv3.common.synchronization [req-3463e601-933c-40e5-9b7e-b97ee5b4b5c8 req-2c874c1d-9a7c-43bc-bd63-98c37f1c58b6 service nova] Enqueued Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGHEST for action security_group_members [ 780.762118] env[69491]: INFO networking_nsxv3.common.synchronization [req-3463e601-933c-40e5-9b7e-b97ee5b4b5c8 req-2c874c1d-9a7c-43bc-bd63-98c37f1c58b6 service nova] Enqueued Resource ID: 40f47d40-2abf-47c7-9f1a-9e1baf0100aa with Priority: HIGHEST for action port [ 780.762392] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGHEST for action security_group_rules [ 780.762527] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGHEST for action security_group_members [ 780.762625] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f47d40-2abf-47c7-9f1a-9e1baf0100aa with Priority: HIGHEST for action port [ 780.763339] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de4976ed-85d7-4836-b6cb-a96b2293c655 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.763429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.763496] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.763754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.763862] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.765136] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4976ed-85d7-4836-b6cb-a96b2293c655 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.765293] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.765396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.765577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.765810] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.765949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.766028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.766187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.766276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.766371] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.767177] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-40f47d40-2abf-47c7-9f1a-9e1baf0100aa taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.767290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40f47d40-2abf-47c7-9f1a-9e1baf0100aa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.767359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40f47d40-2abf-47c7-9f1a-9e1baf0100aa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.767511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40f47d40-2abf-47c7-9f1a-9e1baf0100aa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.767587] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40f47d40-2abf-47c7-9f1a-9e1baf0100aa',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.269792] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4976ed-85d7-4836-b6cb-a96b2293c655 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.270114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.272753] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40f47d40-2abf-47c7-9f1a-9e1baf0100aa with status ACTIVE [ 781.272753] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.272905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.272965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.273229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.273329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.273515] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.273633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.273698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.273881] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.273958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.274150] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.274458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.274458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.274458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.274576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.274676] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40f47d40-2abf-47c7-9f1a-9e1baf0100aa is going to be updated. [ 781.276328] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.308918] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.309131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.309211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.309556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.309675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.309819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40f47d40-2abf-47c7-9f1a-9e1baf0100aa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.780639] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.284768] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.284768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.284768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.284768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.284768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.284768] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de4976ed-85d7-4836-b6cb-a96b2293c655 is going to be created. [ 782.312711] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.313832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.314034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.314334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.314597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.328710] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4976ed-85d7-4836-b6cb-a96b2293c655 in Status: UNINITIALIZED for 2s [ 784.047334] env[69491]: INFO networking_nsxv3.common.synchronization [req-09af9a4b-e9a8-4e9a-86ad-be3ad7965d97 req-8698726a-a29c-4c2e-bc79-8ad8e288b7f9 tempest-FloatingIPsAssociationTestJSON-1311896295 tempest-FloatingIPsAssociationTestJSON-1311896295-project-member] Enqueued Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_members [ 784.048517] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_members [ 784.048517] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.048517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.048517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.048764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.048826] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.048943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.048987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.049979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.049979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.050667] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.338952] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4976ed-85d7-4836-b6cb-a96b2293c655 in Status: SUCCESS [ 784.339287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.339664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.339845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.340132] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.340306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.340420] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.341386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.341886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.341886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.341886] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.553742] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.665376] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-72 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.665584] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-72" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.665712] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-72" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.665998] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-72" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.666287] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.666449] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.666568] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.666949] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.668892] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.668892] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.671112] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.671112] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.671112] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.671112] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.671112] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.671112] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.690140] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.700303] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 784.700303] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.700303] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-72" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.700303] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-c5b3cdf7-f027-45ef-b73b-4606e1a30272 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.700303] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-c5b3cdf7-f027-45ef-b73b-4606e1a30272" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.700303] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-c5b3cdf7-f027-45ef-b73b-4606e1a30272" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.700303] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-c5b3cdf7-f027-45ef-b73b-4606e1a30272" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.700303] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5b3cdf7-f027-45ef-b73b-4606e1a30272',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.849446] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.061311] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.203843] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.205141] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.205141] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.205141] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.205141] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.205141] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port c5b3cdf7-f027-45ef-b73b-4606e1a30272 not found, creating... [ 785.205141] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.205459] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.205459] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.205580] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.205722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.206501] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.206501] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.206501] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.206790] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.206790] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.206893] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: c5b3cdf7-f027-45ef-b73b-4606e1a30272 is going to be created. [ 785.234127] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.236177] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.236177] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.236177] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.236177] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.236177] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-c5b3cdf7-f027-45ef-b73b-4606e1a30272" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.361203] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de4976ed-85d7-4836-b6cb-a96b2293c655: rpc.has_security_group_logging(os_id): False [ 785.383786] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.383950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.384025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.384249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.384341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.384586] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.384693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.384760] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.384902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.384980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.385088] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de4976ed-85d7-4836-b6cb-a96b2293c655 is going to be created. [ 785.472818] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.473085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.473182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.473414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.473615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.492918] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de4976ed-85d7-4836-b6cb-a96b2293c655 in Status: IN_PROGRESS for 2s [ 785.566272] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.566272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.566272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.566518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.566664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.566820] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a is going to be updated. [ 785.632181] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.632396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.632459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.632818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.632818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.644342] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: IN_PROGRESS for 2s [ 786.177581] env[69491]: INFO networking_nsxv3.common.synchronization [req-09af9a4b-e9a8-4e9a-86ad-be3ad7965d97 req-770855ba-bec4-4ff0-ba94-1c01d8a1dbf9 service nova] Enqueued Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_rules [ 786.177803] env[69491]: INFO networking_nsxv3.common.synchronization [req-09af9a4b-e9a8-4e9a-86ad-be3ad7965d97 req-770855ba-bec4-4ff0-ba94-1c01d8a1dbf9 service nova] Enqueued Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_members [ 786.177803] env[69491]: INFO networking_nsxv3.common.synchronization [req-09af9a4b-e9a8-4e9a-86ad-be3ad7965d97 req-770855ba-bec4-4ff0-ba94-1c01d8a1dbf9 service nova] Enqueued Resource ID: c5b3cdf7-f027-45ef-b73b-4606e1a30272 with Priority: HIGHEST for action port [ 786.183254] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_rules [ 786.183254] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_members [ 786.183254] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b3cdf7-f027-45ef-b73b-4606e1a30272 with Priority: HIGHEST for action port [ 786.183254] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.183254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.183254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.183254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.183254] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.183254] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.183254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.183254] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5b3cdf7-f027-45ef-b73b-4606e1a30272 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.183254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5b3cdf7-f027-45ef-b73b-4606e1a30272" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.183254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5b3cdf7-f027-45ef-b73b-4606e1a30272" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.183254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5b3cdf7-f027-45ef-b73b-4606e1a30272" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.183254] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5b3cdf7-f027-45ef-b73b-4606e1a30272',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.685512] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.685639] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.685842] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5b3cdf7-f027-45ef-b73b-4606e1a30272 with status ACTIVE [ 786.686021] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.686138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.686221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.686448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.686535] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.686717] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.686859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.686859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.687036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.687131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.687283] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.687373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.687432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.687581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.687651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.687753] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5b3cdf7-f027-45ef-b73b-4606e1a30272 is going to be updated. [ 786.709740] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.709883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.709955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.710183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.710326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.710501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5b3cdf7-f027-45ef-b73b-4606e1a30272" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.507127] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de4976ed-85d7-4836-b6cb-a96b2293c655 in Status: SUCCESS [ 787.507484] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.654629] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: SUCCESS [ 787.654629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.654629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.654629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.654629] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.654978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.655091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.655263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.655354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.655466] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.158034] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.661072] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.166030] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.166030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.166030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.166030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.166030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.166030] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a is going to be updated. [ 789.206026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.206026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.206026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.206026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.206026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.229327] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: IN_PROGRESS for 2s [ 791.180362] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 791.180728] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 791.242823] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: SUCCESS [ 791.243140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.243378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.243667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.243932] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.244181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.244276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.244633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.244633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.244759] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.244855] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.748945] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.749181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.749273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.749512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.749744] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.749847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.749928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.750120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.750217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.750311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.750518] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.750645] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.750724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.750858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.750998] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.751119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.751183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.751345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.751418] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.751512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.751603] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.256374] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d5a33a2-cab9-4479-9d1c-125f032b265a: rpc.has_security_group_logging(os_id): False [ 792.274238] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.274458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.274852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.275166] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.275166] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.275454] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.275571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.275687] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.275920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.279130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.279538] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.279768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.279871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.280165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.281362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.281362] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.281362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.281362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.281362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.281362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.281362] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a is going to be updated. [ 792.348310] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.348445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.348445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.348611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.348759] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.368210] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: IN_PROGRESS for 2s [ 793.901105] env[69491]: INFO networking_nsxv3.common.synchronization [req-30a6c5a8-066a-4dd4-9ae7-223b07b735c0 req-aa983e5e-bdf3-484b-a37a-285699e651cf tempest-ListImageFiltersTestJSON-361025592 tempest-ListImageFiltersTestJSON-361025592-project-member] Enqueued Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_members [ 793.901631] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_members [ 793.901938] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.902293] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.904420] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.904750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.904959] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.906011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.906011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.906011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.906011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.906011] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.386620] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: SUCCESS [ 794.386845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.408196] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.408351] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.408424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.412020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.412020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.412020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.412020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.412020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.412020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.412020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.412020] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06871947-bfe0-4792-9f13-39942cbccdf7 already deleted. [ 794.412020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.417407] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.417641] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.417849] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.418120] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.418381] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.418532] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.418645] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.418854] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.419079] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.419411] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.419524] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.419631] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.420035] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.420216] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.420349] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.420492] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.443673] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.443883] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 794.445060] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.445060] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.445060] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-20d78b9a-1769-4570-8124-a074a037cc56 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.445060] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-20d78b9a-1769-4570-8124-a074a037cc56" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.445060] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-20d78b9a-1769-4570-8124-a074a037cc56" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.445348] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-20d78b9a-1769-4570-8124-a074a037cc56" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.445348] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20d78b9a-1769-4570-8124-a074a037cc56',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.947636] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.948049] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.948049] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.948357] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.948516] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.948678] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 20d78b9a-1769-4570-8124-a074a037cc56 not found, creating... [ 794.949059] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.949365] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.949506] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.949775] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.949920] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.950238] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.950399] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.950517] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.950738] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.950898] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.951060] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 20d78b9a-1769-4570-8124-a074a037cc56 is going to be created. [ 794.981784] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.982032] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.982192] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.982603] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.982852] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.983102] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-20d78b9a-1769-4570-8124-a074a037cc56" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.916255] env[69491]: INFO networking_nsxv3.common.synchronization [req-30a6c5a8-066a-4dd4-9ae7-223b07b735c0 req-cacaa4b2-df7d-4701-bbc4-5604bf8978c3 service nova] Enqueued Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_rules [ 795.916452] env[69491]: INFO networking_nsxv3.common.synchronization [req-30a6c5a8-066a-4dd4-9ae7-223b07b735c0 req-cacaa4b2-df7d-4701-bbc4-5604bf8978c3 service nova] Enqueued Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_members [ 795.916607] env[69491]: INFO networking_nsxv3.common.synchronization [req-30a6c5a8-066a-4dd4-9ae7-223b07b735c0 req-cacaa4b2-df7d-4701-bbc4-5604bf8978c3 service nova] Enqueued Resource ID: 20d78b9a-1769-4570-8124-a074a037cc56 with Priority: HIGHEST for action port [ 795.917217] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_rules [ 795.917349] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_members [ 795.917516] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20d78b9a-1769-4570-8124-a074a037cc56 with Priority: HIGHEST for action port [ 795.917856] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.917984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.918193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.918402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.918486] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.919495] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.919596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.920059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.920125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.920278] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.920502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.920502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.920635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.920760] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.920859] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.922204] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-20d78b9a-1769-4570-8124-a074a037cc56 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.922204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20d78b9a-1769-4570-8124-a074a037cc56" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.922204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20d78b9a-1769-4570-8124-a074a037cc56" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.922204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20d78b9a-1769-4570-8124-a074a037cc56" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.922204] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20d78b9a-1769-4570-8124-a074a037cc56',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.937844] env[69491]: INFO networking_nsxv3.common.synchronization [None req-0e6066f2-2dd3-4d77-85fd-c0db42b75a59 None None] Enqueued Resource ID: 1ffc26e5-4638-44ea-8f87-76ec3bf60a51 with Priority: HIGHEST for action port [ 795.939032] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ffc26e5-4638-44ea-8f87-76ec3bf60a51 with Priority: HIGHEST for action port [ 795.939032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ffc26e5-4638-44ea-8f87-76ec3bf60a51 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.939032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ffc26e5-4638-44ea-8f87-76ec3bf60a51" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.939032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ffc26e5-4638-44ea-8f87-76ec3bf60a51" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.943898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ffc26e5-4638-44ea-8f87-76ec3bf60a51" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.943898] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ffc26e5-4638-44ea-8f87-76ec3bf60a51',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.425437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.425864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.425864] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.427014] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20d78b9a-1769-4570-8124-a074a037cc56 with status ACTIVE [ 796.427230] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.427357] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.427469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.427764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.427864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.428229] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.428343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.428510] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.428592] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.428675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.429045] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.429188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.429264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.429430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.429508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.429601] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20d78b9a-1769-4570-8124-a074a037cc56 is going to be updated. [ 796.446782] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ffc26e5-4638-44ea-8f87-76ec3bf60a51 [ 796.447032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.447175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.447245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.447458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.447553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.447646] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ffc26e5-4638-44ea-8f87-76ec3bf60a51 already deleted. [ 796.447719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ffc26e5-4638-44ea-8f87-76ec3bf60a51" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.454558] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.454745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.454800] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.454994] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.455162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.455333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20d78b9a-1769-4570-8124-a074a037cc56" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.932925] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.438242] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.438242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.438242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.438825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.438825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.438825] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06871947-bfe0-4792-9f13-39942cbccdf7 is going to be created. [ 797.463472] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.463669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.463669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.463920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.464101] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.474014] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: UNINITIALIZED for 2s [ 798.863687] env[69491]: INFO networking_nsxv3.common.synchronization [None req-2ff7f97d-2876-4a13-92ac-2f97774980aa None None] Enqueued Resource ID: 2c4a14e8-8ee9-4ffe-8c87-d810ab89bf55 with Priority: HIGHEST for action port [ 798.863687] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c4a14e8-8ee9-4ffe-8c87-d810ab89bf55 with Priority: HIGHEST for action port [ 798.865015] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c4a14e8-8ee9-4ffe-8c87-d810ab89bf55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.865015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c4a14e8-8ee9-4ffe-8c87-d810ab89bf55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.865015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c4a14e8-8ee9-4ffe-8c87-d810ab89bf55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.865015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c4a14e8-8ee9-4ffe-8c87-d810ab89bf55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.865015] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c4a14e8-8ee9-4ffe-8c87-d810ab89bf55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.375448] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c4a14e8-8ee9-4ffe-8c87-d810ab89bf55 [ 799.376170] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.377169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.377169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.377169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.377169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.377169] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c4a14e8-8ee9-4ffe-8c87-d810ab89bf55 already deleted. [ 799.377169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c4a14e8-8ee9-4ffe-8c87-d810ab89bf55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.469809] env[69491]: INFO networking_nsxv3.common.synchronization [req-bf7b7cc9-f949-431a-9b3a-2c3d2bc9a035 req-8a29f0ef-eb3e-45cb-ac44-6ddcd80662e2 tempest-ListImageFiltersTestJSON-361025592 tempest-ListImageFiltersTestJSON-361025592-project-member] Enqueued Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_members [ 799.470623] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_members [ 799.470715] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.470815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.484654] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: SUCCESS [ 799.484769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.484923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.485219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.485417] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.485553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.485620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.485775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.485859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.485943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.486069] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.489987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.490374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.490590] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.490752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.490858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.491149] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.491254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.491469] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.994058] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.994576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.994576] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.156562] env[69491]: INFO networking_nsxv3.common.synchronization [None req-bd3a69ea-b655-4ae2-b44b-bfb7574e3e53 None None] Enqueued Resource ID: 7817392d-a4f5-4147-bf26-3e77c30ef9b8 with Priority: HIGHEST for action port [ 800.157159] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7817392d-a4f5-4147-bf26-3e77c30ef9b8 with Priority: HIGHEST for action port [ 800.157477] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-7817392d-a4f5-4147-bf26-3e77c30ef9b8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.157607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7817392d-a4f5-4147-bf26-3e77c30ef9b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.157673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7817392d-a4f5-4147-bf26-3e77c30ef9b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.157959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7817392d-a4f5-4147-bf26-3e77c30ef9b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.161449] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7817392d-a4f5-4147-bf26-3e77c30ef9b8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.371873] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.371873] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.371873] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.371873] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.371873] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.371873] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.371873] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.372322] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.372322] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.372557] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 800.372673] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 800.372734] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 800.372801] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 800.372922] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 800.373080] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 800.373173] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 800.399493] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 800.399493] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 800.399493] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 800.399493] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.399694] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-78eea185-1a14-459d-a081-03e143f7577c taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.399832] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-78eea185-1a14-459d-a081-03e143f7577c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.401084] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-78eea185-1a14-459d-a081-03e143f7577c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.401084] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-78eea185-1a14-459d-a081-03e143f7577c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.401084] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78eea185-1a14-459d-a081-03e143f7577c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.500333] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.664791] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7817392d-a4f5-4147-bf26-3e77c30ef9b8 [ 800.664791] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.664791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.664791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.664791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.664791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.664791] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7817392d-a4f5-4147-bf26-3e77c30ef9b8 already deleted. [ 800.664791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7817392d-a4f5-4147-bf26-3e77c30ef9b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.903490] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.903490] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.903864] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.904019] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.904179] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.904338] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 78eea185-1a14-459d-a081-03e143f7577c not found, creating... [ 800.905191] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.905191] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.905191] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.905330] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.905360] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.905696] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.905799] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.905905] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.906327] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.906541] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.906612] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 78eea185-1a14-459d-a081-03e143f7577c is going to be created. [ 800.931773] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.931773] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.931773] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.932302] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.933679] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.935019] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-78eea185-1a14-459d-a081-03e143f7577c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.005507] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.005507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.005507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.005507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.005507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.005507] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06871947-bfe0-4792-9f13-39942cbccdf7 is going to be updated. [ 801.072088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.072197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.072291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.072522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.072671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.084760] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: IN_PROGRESS for 2s [ 802.116355] env[69491]: INFO networking_nsxv3.common.synchronization [req-bf7b7cc9-f949-431a-9b3a-2c3d2bc9a035 req-d828aab1-83f8-4188-9492-38e5760c7aab service nova] Enqueued Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_rules [ 802.116634] env[69491]: INFO networking_nsxv3.common.synchronization [req-bf7b7cc9-f949-431a-9b3a-2c3d2bc9a035 req-d828aab1-83f8-4188-9492-38e5760c7aab service nova] Enqueued Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_members [ 802.116781] env[69491]: INFO networking_nsxv3.common.synchronization [req-bf7b7cc9-f949-431a-9b3a-2c3d2bc9a035 req-d828aab1-83f8-4188-9492-38e5760c7aab service nova] Enqueued Resource ID: 78eea185-1a14-459d-a081-03e143f7577c with Priority: HIGHEST for action port [ 802.116905] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_rules [ 802.117052] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_members [ 802.117172] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78eea185-1a14-459d-a081-03e143f7577c with Priority: HIGHEST for action port [ 802.117823] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.117942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.118543] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.118717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.119035] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-78eea185-1a14-459d-a081-03e143f7577c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.119207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78eea185-1a14-459d-a081-03e143f7577c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.119329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78eea185-1a14-459d-a081-03e143f7577c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.119806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78eea185-1a14-459d-a081-03e143f7577c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.120051] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78eea185-1a14-459d-a081-03e143f7577c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.622564] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78eea185-1a14-459d-a081-03e143f7577c with status ACTIVE [ 802.625437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.625437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.625437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.625437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.625437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.625437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.625437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.625437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.625437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.625437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.625437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.625437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.625437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.625437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.625437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.625437] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78eea185-1a14-459d-a081-03e143f7577c is going to be updated. [ 802.652695] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.652906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.652906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.653067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.653607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.653607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78eea185-1a14-459d-a081-03e143f7577c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.043279] env[69491]: INFO networking_nsxv3.common.synchronization [None req-24bac017-c2c9-4a1c-92ba-db9359926029 None None] Enqueued Resource ID: 834c78af-1943-4fc5-b538-56517e1b2616 with Priority: HIGHEST for action port [ 803.044794] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 834c78af-1943-4fc5-b538-56517e1b2616 with Priority: HIGHEST for action port [ 803.044794] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-834c78af-1943-4fc5-b538-56517e1b2616 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.044794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-834c78af-1943-4fc5-b538-56517e1b2616" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.044794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-834c78af-1943-4fc5-b538-56517e1b2616" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.049018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-834c78af-1943-4fc5-b538-56517e1b2616" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.049018] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('834c78af-1943-4fc5-b538-56517e1b2616',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.101023] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: SUCCESS [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.101023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.101023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.101023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.101023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.101843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.101843] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.103586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.108043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.108043] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.108043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.108043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.108043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.108043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.108043] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.549115] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 834c78af-1943-4fc5-b538-56517e1b2616 [ 803.549115] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.549115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.549115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.549115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.549115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.549608] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:834c78af-1943-4fc5-b538-56517e1b2616 already deleted. [ 803.549608] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-834c78af-1943-4fc5-b538-56517e1b2616" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.609928] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06871947-bfe0-4792-9f13-39942cbccdf7: rpc.has_security_group_logging(os_id): False [ 803.613639] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.630557] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.630729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.630765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.630981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.631075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.631264] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.631837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.631837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.631837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.631837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.632040] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.632040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.632040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.632236] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.632460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.632460] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.632568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.632612] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.632805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.632805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.632896] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06871947-bfe0-4792-9f13-39942cbccdf7 is going to be created. [ 803.711958] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.711958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.711958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.711958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.711958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.725029] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: IN_PROGRESS for 2s [ 804.116327] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.619174] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.619174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.619174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.619547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.619547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.619547] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06871947-bfe0-4792-9f13-39942cbccdf7 is going to be updated. [ 804.650471] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.650727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.650920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.651169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.651375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.666068] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: IN_PROGRESS for 2s [ 805.277249] env[69491]: INFO networking_nsxv3.common.synchronization [req-cf005657-3e9c-4166-a85f-a4a9287d578a req-e94d9a09-2587-417e-b2de-16ead93ca5e2 tempest-ImagesTestJSON-1178517317 tempest-ImagesTestJSON-1178517317-project-member] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 805.277784] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 805.278540] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.278679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.278782] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.278959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.279135] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.279238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.279301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.279452] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.279537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.279625] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.738428] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: SUCCESS [ 805.738831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.738896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.739151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.739253] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.782157] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.782356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.782428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.782660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.782755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.782967] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.783080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.783146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.783310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.783388] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.783488] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 805.811128] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.811458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.811532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.812153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.812308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.820835] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 806.243620] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.243620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.593124] env[69491]: INFO networking_nsxv3.common.synchronization [req-70f0cd76-0a6f-4a52-854f-fcad6d11ddf9 req-32be6fba-703b-4e5a-a594-0aa3a7c2b68e tempest-FloatingIPsAssociationTestJSON-1311896295 tempest-FloatingIPsAssociationTestJSON-1311896295-project-member] Enqueued Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_members [ 806.593837] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_members [ 806.594224] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.594384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.594461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.594692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.594876] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.594989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.595092] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.595253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.595362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.595484] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.676550] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: SUCCESS [ 806.676800] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.676800] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.679031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.679031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.679031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.679031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.679031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.679031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.679031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.679031] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.098345] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.181710] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.181915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.181977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.182224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.182510] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.182616] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.182665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.182804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.182893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.182984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.183149] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.183246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.183302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.183491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.183637] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.183732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.183798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.183937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.184022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.184104] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.184196] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.603575] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.688401] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06871947-bfe0-4792-9f13-39942cbccdf7: rpc.has_security_group_logging(os_id): False [ 807.707420] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.707618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.707727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.708035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.708180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.708447] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.708592] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.708691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.708920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.709158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.709648] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.709648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.709731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.709888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.710012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.710312] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.710450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.710836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.710836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.710836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.710971] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06871947-bfe0-4792-9f13-39942cbccdf7 is going to be updated. [ 807.797833] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.798061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.798061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.798322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.798478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.812206] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: IN_PROGRESS for 2s [ 807.837023] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 807.837023] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 deletion is rescheduled due to dependency. [ 807.837023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.108572] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.108860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.108860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.110495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.110495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.110495] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a is going to be updated. [ 808.138306] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.138416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.138492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.138700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.138843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.149935] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: IN_PROGRESS for 2s [ 808.742481] env[69491]: INFO networking_nsxv3.common.synchronization [req-5842e684-56e9-46c4-88b7-0b29950fd84a req-de01129b-0fcb-41f7-a7af-125dac3fc965 tempest-AttachInterfacesUnderV243Test-1007658330 tempest-AttachInterfacesUnderV243Test-1007658330-project-member] Enqueued Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 808.742481] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 808.742481] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.742853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.743077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.743367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.743957] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.744961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.744961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.744961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.744961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.744961] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.778886] env[69491]: INFO networking_nsxv3.common.synchronization [req-5842e684-56e9-46c4-88b7-0b29950fd84a req-de01129b-0fcb-41f7-a7af-125dac3fc965 tempest-AttachInterfacesUnderV243Test-1007658330 tempest-AttachInterfacesUnderV243Test-1007658330-project-member] Enqueued Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_rules [ 808.779084] env[69491]: INFO networking_nsxv3.common.synchronization [req-5842e684-56e9-46c4-88b7-0b29950fd84a req-de01129b-0fcb-41f7-a7af-125dac3fc965 tempest-AttachInterfacesUnderV243Test-1007658330 tempest-AttachInterfacesUnderV243Test-1007658330-project-member] Enqueued Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 808.779227] env[69491]: INFO networking_nsxv3.common.synchronization [req-5842e684-56e9-46c4-88b7-0b29950fd84a req-de01129b-0fcb-41f7-a7af-125dac3fc965 tempest-AttachInterfacesUnderV243Test-1007658330 tempest-AttachInterfacesUnderV243Test-1007658330-project-member] Enqueued Resource ID: 6d188c80-ea15-4a49-ab8a-07ad0c42cbda with Priority: HIGHEST for action port [ 808.779691] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_rules [ 808.779828] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 808.779931] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d188c80-ea15-4a49-ab8a-07ad0c42cbda with Priority: HIGHEST for action port [ 808.782488] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.782488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.782488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.782488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.782488] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.782823] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.782823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.782998] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.783152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.783406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.783638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.783747] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d188c80-ea15-4a49-ab8a-07ad0c42cbda',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.167393] env[69491]: INFO networking_nsxv3.common.synchronization [None req-d0780cdf-df43-4573-9cbf-0b9133e45ea7 None None] Enqueued Resource ID: 5a21e21b-f529-4434-85e4-4ae9e7d48566 with Priority: HIGHEST for action port [ 809.167644] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a21e21b-f529-4434-85e4-4ae9e7d48566 with Priority: HIGHEST for action port [ 809.168968] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a21e21b-f529-4434-85e4-4ae9e7d48566 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.168968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a21e21b-f529-4434-85e4-4ae9e7d48566" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.168968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a21e21b-f529-4434-85e4-4ae9e7d48566" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.168968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a21e21b-f529-4434-85e4-4ae9e7d48566" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.169491] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a21e21b-f529-4434-85e4-4ae9e7d48566',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.247152] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.285867] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.285998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.288504] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d188c80-ea15-4a49-ab8a-07ad0c42cbda with status ACTIVE [ 809.288708] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.288826] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.288898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.289169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.289211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.289386] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.289479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.289576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.289684] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.289758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.289936] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.290048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.290111] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.290369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.290369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.290439] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d188c80-ea15-4a49-ab8a-07ad0c42cbda is going to be updated. [ 809.315874] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.316039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.316085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.316250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.316381] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.316537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.672130] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a21e21b-f529-4434-85e4-4ae9e7d48566 [ 809.672130] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.672130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.672130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.672370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.672370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.672439] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a21e21b-f529-4434-85e4-4ae9e7d48566 already deleted. [ 809.674416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a21e21b-f529-4434-85e4-4ae9e7d48566" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.749302] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.829760] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: SUCCESS [ 809.829760] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.985421] env[69491]: INFO networking_nsxv3.common.synchronization [None req-1ca2b098-68cd-4802-a6a9-afa54f0543ae tempest-ServersTestManualDisk-1552727568 tempest-ServersTestManualDisk-1552727568-project-member] Enqueued Resource ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f with Priority: HIGHEST for action security_group_rules [ 809.988470] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f with Priority: HIGHEST for action security_group_rules [ 809.989853] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.990017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.990116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.990556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.990684] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.073510] env[69491]: INFO networking_nsxv3.common.synchronization [None req-0c44151e-461e-439e-9746-9a8a4e0d26c0 tempest-ServersTestManualDisk-1552727568 tempest-ServersTestManualDisk-1552727568-project-member] Enqueued Resource ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f with Priority: HIGHEST for action security_group_rules [ 810.074768] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f with Priority: HIGHEST for action security_group_rules [ 810.075129] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.075270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.161769] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: SUCCESS [ 810.161769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.252659] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.253039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.254723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.254723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.254723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.254723] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0b71710-cca2-4c0f-bcce-171044129d44 is going to be updated. [ 810.286670] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.288421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.288421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.288421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.288583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.302273] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0b71710-cca2-4c0f-bcce-171044129d44 in Status: IN_PROGRESS for 2s [ 810.516621] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.516621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.516621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.516621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.516621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.516621] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f already deleted. [ 810.516621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.516621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.516621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.516621] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.037932] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.038872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.038977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.039219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.039313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.039412] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f already deleted. [ 811.039498] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.253024] env[69491]: INFO networking_nsxv3.common.synchronization [None req-e290c1de-254a-46e4-b088-73cf1dbe85c0 None None] Enqueued Resource ID: 4f3c4443-0a12-4f4a-a9a8-2c95fa52f7b4 with Priority: HIGHEST for action port [ 812.253363] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3c4443-0a12-4f4a-a9a8-2c95fa52f7b4 with Priority: HIGHEST for action port [ 812.253924] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f3c4443-0a12-4f4a-a9a8-2c95fa52f7b4 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.255968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f3c4443-0a12-4f4a-a9a8-2c95fa52f7b4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.256069] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f3c4443-0a12-4f4a-a9a8-2c95fa52f7b4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.256356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f3c4443-0a12-4f4a-a9a8-2c95fa52f7b4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.256459] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f3c4443-0a12-4f4a-a9a8-2c95fa52f7b4',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.315655] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0b71710-cca2-4c0f-bcce-171044129d44 in Status: SUCCESS [ 812.315990] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.316485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.316485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.316949] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.316949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.316949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.317165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.317165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.317296] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.760462] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f3c4443-0a12-4f4a-a9a8-2c95fa52f7b4 [ 812.760711] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.760848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.760918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.761162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.761290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.761429] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f3c4443-0a12-4f4a-a9a8-2c95fa52f7b4 already deleted. [ 812.761496] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f3c4443-0a12-4f4a-a9a8-2c95fa52f7b4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.820390] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.324082] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.669109] env[69491]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 813.669109] env[69491]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] NSXv3 Agent Agent loop - iteration:1 started [ 813.827198] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.827358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.827433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.827662] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.827753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.827854] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0b71710-cca2-4c0f-bcce-171044129d44 is going to be updated. [ 813.855952] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.856131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.856227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.856520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.856737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.867700] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0b71710-cca2-4c0f-bcce-171044129d44 in Status: IN_PROGRESS for 2s [ 813.954451] env[69491]: INFO networking_nsxv3.common.synchronization [req-77775c86-6cc1-4f1d-b4ce-b49baf5ac5c5 req-df4b4166-d0f5-4357-a758-cce1db10f77f tempest-AttachInterfacesUnderV243Test-1007658330 tempest-AttachInterfacesUnderV243Test-1007658330-project-member] Enqueued Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 813.955070] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 813.959026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.959026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.971032] env[69491]: INFO networking_nsxv3.common.synchronization [req-77775c86-6cc1-4f1d-b4ce-b49baf5ac5c5 req-df4b4166-d0f5-4357-a758-cce1db10f77f tempest-AttachInterfacesUnderV243Test-1007658330 tempest-AttachInterfacesUnderV243Test-1007658330-project-member] Enqueued Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_rules [ 813.971242] env[69491]: INFO networking_nsxv3.common.synchronization [req-77775c86-6cc1-4f1d-b4ce-b49baf5ac5c5 req-df4b4166-d0f5-4357-a758-cce1db10f77f tempest-AttachInterfacesUnderV243Test-1007658330 tempest-AttachInterfacesUnderV243Test-1007658330-project-member] Enqueued Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 813.971464] env[69491]: INFO networking_nsxv3.common.synchronization [req-77775c86-6cc1-4f1d-b4ce-b49baf5ac5c5 req-df4b4166-d0f5-4357-a758-cce1db10f77f tempest-AttachInterfacesUnderV243Test-1007658330 tempest-AttachInterfacesUnderV243Test-1007658330-project-member] Enqueued Resource ID: 6d188c80-ea15-4a49-ab8a-07ad0c42cbda with Priority: HIGHEST for action port [ 813.972297] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_rules [ 813.972429] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 813.972524] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d188c80-ea15-4a49-ab8a-07ad0c42cbda with Priority: HIGHEST for action port [ 813.972795] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.972891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.973132] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.973259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.973471] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.973562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.973623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.973821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.973901] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d188c80-ea15-4a49-ab8a-07ad0c42cbda',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.478427] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d188c80-ea15-4a49-ab8a-07ad0c42cbda with status ACTIVE [ 814.478799] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.478799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.478910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.479145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.479257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.479451] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.479581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.479654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.479813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.479890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.480090] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.480190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.480252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.480444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.480515] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.480602] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d188c80-ea15-4a49-ab8a-07ad0c42cbda is going to be updated. [ 814.506157] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.506395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.506584] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.506756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.506921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.507312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d188c80-ea15-4a49-ab8a-07ad0c42cbda" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.877528] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0b71710-cca2-4c0f-bcce-171044129d44 in Status: SUCCESS [ 815.877867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.877909] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.878918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.878918] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.878918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.878918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.878918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.878918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.878918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.879399] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.879848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.880045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.880204] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.880311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.880427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.880582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.880664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.880747] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.384555] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.385591] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.887338] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0b71710-cca2-4c0f-bcce-171044129d44: rpc.has_security_group_logging(os_id): False [ 816.888532] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.914119] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.914119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.914119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.914119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.914119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.914119] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.914119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.914119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.914119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.914119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.914119] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0b71710-cca2-4c0f-bcce-171044129d44 is going to be updated. [ 816.979354] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.979774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.983135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.983135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.983135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.997519] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0b71710-cca2-4c0f-bcce-171044129d44 in Status: IN_PROGRESS for 2s [ 817.392085] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.394081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.394081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.394081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.394081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.394081] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0b71710-cca2-4c0f-bcce-171044129d44 is going to be updated. [ 817.430040] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.430189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.430268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.430566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.430735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.441887] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0b71710-cca2-4c0f-bcce-171044129d44 in Status: IN_PROGRESS for 2s [ 817.816413] env[69491]: INFO networking_nsxv3.common.synchronization [req-851ffe63-646c-46e7-9be6-849738f1ec98 req-5e4715b1-999e-48b2-b36d-7ad8571de089 tempest-AttachInterfacesUnderV243Test-1007658330 tempest-AttachInterfacesUnderV243Test-1007658330-project-member] Enqueued Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 817.816702] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b71710-cca2-4c0f-bcce-171044129d44 with Priority: HIGHEST for action security_group_members [ 817.816888] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b71710-cca2-4c0f-bcce-171044129d44 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.816964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.514255] env[69491]: INFO networking_nsxv3.common.synchronization [req-d83ea0ea-695a-4735-91b1-0cbdbd8e8848 req-570a1413-04fe-4d98-ba9a-b3754f15b737 tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGHEST for action security_group_members [ 818.514969] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGHEST for action security_group_members [ 818.515379] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-62c4aff5-ba77-43c8-9eb6-a56da143180b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.515538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.515831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.515974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.517884] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.517884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.517884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.517884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.517884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.517884] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.013947] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0b71710-cca2-4c0f-bcce-171044129d44 in Status: SUCCESS [ 819.014209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.014417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.014641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.016095] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.020575] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.020735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.020808] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.021489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.021616] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.021819] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.021921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.021982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.022193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.022287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.022377] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b already deleted. [ 819.022458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.340728] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-348 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.340939] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.341087] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.341437] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.341745] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.341914] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.342645] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.343083] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.343182] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.343355] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.343545] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.343612] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.343802] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.343802] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.343908] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.344040] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.364408] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.364573] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 819.364713] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.364894] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.365245] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-012e9062-8610-4143-9a09-5d76b372e003 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.365420] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-012e9062-8610-4143-9a09-5d76b372e003" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.365550] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-012e9062-8610-4143-9a09-5d76b372e003" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.365900] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-012e9062-8610-4143-9a09-5d76b372e003" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.366061] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('012e9062-8610-4143-9a09-5d76b372e003',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.452994] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0b71710-cca2-4c0f-bcce-171044129d44 in Status: SUCCESS [ 819.453210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.453380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.453604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.453796] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.454398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.454398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.454398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.454398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.454398] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.536500] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.536782] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.536782] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.537694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.537694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.537694] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0b71710-cca2-4c0f-bcce-171044129d44 is going to be deleted. [ 819.602012] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.602217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.602323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.602457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.602596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.602669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.871277] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.871277] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.871624] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.871816] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.871972] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.872275] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 012e9062-8610-4143-9a09-5d76b372e003 not found, creating... [ 819.872563] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.872906] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.872906] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.873403] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.873403] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.876429] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.876719] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.876788] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.876983] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.878120] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.878120] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 012e9062-8610-4143-9a09-5d76b372e003 is going to be created. [ 819.906323] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.906533] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.906656] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.906945] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.907500] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.907500] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-012e9062-8610-4143-9a09-5d76b372e003" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.964594] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.964594] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.964594] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.965013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.965013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.965318] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.965484] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.965544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.965818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.965950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.966563] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0b71710-cca2-4c0f-bcce-171044129d44 is going to be deleted. [ 820.012399] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.012575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.012668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.012824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.012961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.013125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.013798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.013981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.014177] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.014286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.014349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.014506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.014583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.014681] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0b71710-cca2-4c0f-bcce-171044129d44',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.521021] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.521021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.521021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.521021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.521021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.521021] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.521021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.521021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.521021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.521021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.521021] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0b71710-cca2-4c0f-bcce-171044129d44 already deleted. [ 820.521021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b71710-cca2-4c0f-bcce-171044129d44" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.089509] env[69491]: INFO networking_nsxv3.common.synchronization [req-2ad83b2c-213e-4c83-9ecf-da10a2b935e5 req-603a8afd-0bff-41d4-8788-b2d9c4db748d tempest-ServerPasswordTestJSON-37813558 tempest-ServerPasswordTestJSON-37813558-project-member] Enqueued Resource ID: 337bf73b-206c-43a7-940b-8771364a9da6 with Priority: HIGHEST for action security_group_members [ 821.090708] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 337bf73b-206c-43a7-940b-8771364a9da6 with Priority: HIGHEST for action security_group_members [ 821.090708] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-337bf73b-206c-43a7-940b-8771364a9da6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.090708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.090708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.091049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.091221] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.091325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.091387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.091589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.091680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.091775] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('337bf73b-206c-43a7-940b-8771364a9da6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.261990] env[69491]: INFO networking_nsxv3.common.synchronization [req-d83ea0ea-695a-4735-91b1-0cbdbd8e8848 req-d6d7c98d-ab2d-4fd3-a764-ba52471b46e0 service nova] Enqueued Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGHEST for action security_group_rules [ 821.262207] env[69491]: INFO networking_nsxv3.common.synchronization [req-d83ea0ea-695a-4735-91b1-0cbdbd8e8848 req-d6d7c98d-ab2d-4fd3-a764-ba52471b46e0 service nova] Enqueued Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGHEST for action security_group_members [ 821.262352] env[69491]: INFO networking_nsxv3.common.synchronization [req-d83ea0ea-695a-4735-91b1-0cbdbd8e8848 req-d6d7c98d-ab2d-4fd3-a764-ba52471b46e0 service nova] Enqueued Resource ID: 012e9062-8610-4143-9a09-5d76b372e003 with Priority: HIGHEST for action port [ 821.262589] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGHEST for action security_group_rules [ 821.262723] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGHEST for action security_group_members [ 821.262882] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012e9062-8610-4143-9a09-5d76b372e003 with Priority: HIGHEST for action port [ 821.263418] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62c4aff5-ba77-43c8-9eb6-a56da143180b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.263570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.263638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.263836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.263917] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.265527] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-62c4aff5-ba77-43c8-9eb6-a56da143180b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.265527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.265527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.265527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.265779] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.265779] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.265779] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.265887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.265921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.266023] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.266797] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-012e9062-8610-4143-9a09-5d76b372e003 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.266897] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-012e9062-8610-4143-9a09-5d76b372e003" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.266971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-012e9062-8610-4143-9a09-5d76b372e003" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.267892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-012e9062-8610-4143-9a09-5d76b372e003" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.269218] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('012e9062-8610-4143-9a09-5d76b372e003',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.595103] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.595320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.595401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.595623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.595720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.595944] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.596057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.596121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.596279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.596356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.596443] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 337bf73b-206c-43a7-940b-8771364a9da6 already deleted. [ 821.596545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.732672] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.734282] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-84" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.734589] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-84" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.734987] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-84" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.735386] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.735698] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.735910] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.736236] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.736478] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.736794] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.737155] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.738377] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.738377] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.738747] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.738747] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.738747] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.760875] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.761072] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.761222] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.762033] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-84" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.762033] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-fbeab8bf-0540-4474-a785-df31ce232b21 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.762033] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-fbeab8bf-0540-4474-a785-df31ce232b21" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.762033] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-fbeab8bf-0540-4474-a785-df31ce232b21" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.762423] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-fbeab8bf-0540-4474-a785-df31ce232b21" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.762506] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbeab8bf-0540-4474-a785-df31ce232b21',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.771046] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 012e9062-8610-4143-9a09-5d76b372e003 with status ACTIVE [ 821.771046] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.771046] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.771046] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.771046] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.771320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.772030] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.772030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.772030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.772030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.772030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.772030] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.772333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.772333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.772647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.772736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.772842] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 012e9062-8610-4143-9a09-5d76b372e003 is going to be updated. [ 821.774016] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-62c4aff5-ba77-43c8-9eb6-a56da143180b taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.774266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.774326] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.798123] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.798123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.798123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.798123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.798123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.798123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-012e9062-8610-4143-9a09-5d76b372e003" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.266433] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.266433] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.266433] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.266433] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.266433] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.266433] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port fbeab8bf-0540-4474-a785-df31ce232b21 not found, creating... [ 822.266433] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.266433] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.267081] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.267081] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.267081] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.268025] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.268025] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.268025] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.268025] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.268317] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.268317] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: fbeab8bf-0540-4474-a785-df31ce232b21 is going to be created. [ 822.279214] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.290325] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.290534] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.290717] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.291019] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.291255] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.291571] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-fbeab8bf-0540-4474-a785-df31ce232b21" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.784446] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.784446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.784446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.784446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.784446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.784446] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b is going to be created. [ 822.815862] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.815862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.815862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.815862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.815862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.825457] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b in Status: UNINITIALIZED for 2s [ 823.538169] env[69491]: INFO networking_nsxv3.common.synchronization [req-2ad83b2c-213e-4c83-9ecf-da10a2b935e5 req-9a52aa5b-e8e4-4147-a434-cf8916ff12ab service nova] Enqueued Resource ID: 337bf73b-206c-43a7-940b-8771364a9da6 with Priority: HIGHEST for action security_group_rules [ 823.538417] env[69491]: INFO networking_nsxv3.common.synchronization [req-2ad83b2c-213e-4c83-9ecf-da10a2b935e5 req-9a52aa5b-e8e4-4147-a434-cf8916ff12ab service nova] Enqueued Resource ID: 337bf73b-206c-43a7-940b-8771364a9da6 with Priority: HIGHEST for action security_group_members [ 823.538496] env[69491]: INFO networking_nsxv3.common.synchronization [req-2ad83b2c-213e-4c83-9ecf-da10a2b935e5 req-9a52aa5b-e8e4-4147-a434-cf8916ff12ab service nova] Enqueued Resource ID: fbeab8bf-0540-4474-a785-df31ce232b21 with Priority: HIGHEST for action port [ 823.538932] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 337bf73b-206c-43a7-940b-8771364a9da6 with Priority: HIGHEST for action security_group_rules [ 823.539084] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 337bf73b-206c-43a7-940b-8771364a9da6 with Priority: HIGHEST for action security_group_members [ 823.539182] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbeab8bf-0540-4474-a785-df31ce232b21 with Priority: HIGHEST for action port [ 823.539754] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-337bf73b-206c-43a7-940b-8771364a9da6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.539886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.539958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.540420] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.540507] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('337bf73b-206c-43a7-940b-8771364a9da6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.541454] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-337bf73b-206c-43a7-940b-8771364a9da6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.541565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.541620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.541828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.541980] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.542088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.542189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.542302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.542386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.542478] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('337bf73b-206c-43a7-940b-8771364a9da6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.543358] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbeab8bf-0540-4474-a785-df31ce232b21 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.543472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbeab8bf-0540-4474-a785-df31ce232b21" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.543543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbeab8bf-0540-4474-a785-df31ce232b21" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.543694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbeab8bf-0540-4474-a785-df31ce232b21" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.543770] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbeab8bf-0540-4474-a785-df31ce232b21',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.947127] env[69491]: INFO networking_nsxv3.common.synchronization [req-faf4d4cf-115a-4036-bbb2-12604aeae69f req-a9fded0c-c1e0-4cc9-b405-74305cd5a463 tempest-ServerMetadataTestJSON-530440074 tempest-ServerMetadataTestJSON-530440074-project-member] Enqueued Resource ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 with Priority: HIGHEST for action security_group_members [ 823.947663] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 with Priority: HIGHEST for action security_group_members [ 823.947976] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4e738a-9dc2-4f83-b900-32903fbd0277 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.948111] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.948181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.948432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.948613] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.948710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.948793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.948917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.949015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.949856] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4e738a-9dc2-4f83-b900-32903fbd0277',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.045511] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-337bf73b-206c-43a7-940b-8771364a9da6 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.045651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.047069] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('337bf73b-206c-43a7-940b-8771364a9da6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.047953] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbeab8bf-0540-4474-a785-df31ce232b21 with status ACTIVE [ 824.048193] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.048495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.048495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.048702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.048702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.048803] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.048911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.048962] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.049119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.049199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.049388] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.049481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.049536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.049672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.049745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.049828] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbeab8bf-0540-4474-a785-df31ce232b21 is going to be updated. [ 824.078820] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.078820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.078820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.078820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.078820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.078820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbeab8bf-0540-4474-a785-df31ce232b21" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.453567] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.453757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.453801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.454100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.454146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.454351] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.454657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.454657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.454790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.454868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.454952] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 already deleted. [ 824.455043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.555239] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('337bf73b-206c-43a7-940b-8771364a9da6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.734826] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-554 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.735025] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-554" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.735149] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-554" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.735486] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-554" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.735756] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.735909] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.736093] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.736330] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.736472] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.736688] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 824.736802] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 824.736912] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 824.737033] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 824.737152] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 824.737260] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 824.737392] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 824.763217] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 824.763217] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 824.763217] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 824.763217] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-554" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.763471] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-f4a764d6-dec3-4e91-a665-43806392161f taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.763471] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-f4a764d6-dec3-4e91-a665-43806392161f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.763602] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-f4a764d6-dec3-4e91-a665-43806392161f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.763965] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-f4a764d6-dec3-4e91-a665-43806392161f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.764339] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4a764d6-dec3-4e91-a665-43806392161f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.837599] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b in Status: SUCCESS [ 824.837845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.838035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.838267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.838609] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.838609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.838910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.838910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.838910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.839028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.839419] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.057540] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.061020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.061020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.061020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.061020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.061020] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 337bf73b-206c-43a7-940b-8771364a9da6 is going to be created. [ 825.086462] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.086624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.086674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.087020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.087227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.098702] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 337bf73b-206c-43a7-940b-8771364a9da6 in Status: UNINITIALIZED for 2s [ 825.269722] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.269722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.269722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.269722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.269722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.269722] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port f4a764d6-dec3-4e91-a665-43806392161f not found, creating... [ 825.269722] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.269722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.269722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.269722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.269722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.270568] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.271110] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.271411] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.273588] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.273588] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.273588] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: f4a764d6-dec3-4e91-a665-43806392161f is going to be created. [ 825.295291] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.295291] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.295291] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.295291] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.295291] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.295291] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-f4a764d6-dec3-4e91-a665-43806392161f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.344397] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.846792] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62c4aff5-ba77-43c8-9eb6-a56da143180b: rpc.has_security_group_logging(os_id): False [ 825.867414] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.867615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.867772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.867878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.867971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.868260] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.868364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.868422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.868585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.868736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.868852] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b is going to be created. [ 825.947688] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.947994] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.948569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.948569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.948758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.963821] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b in Status: IN_PROGRESS for 2s [ 826.684080] env[69491]: INFO networking_nsxv3.common.synchronization [req-faf4d4cf-115a-4036-bbb2-12604aeae69f req-f1dd46a8-6055-45fc-b6f1-4ec6cf4a15c8 service nova] Enqueued Resource ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 with Priority: HIGHEST for action security_group_rules [ 826.687593] env[69491]: INFO networking_nsxv3.common.synchronization [req-faf4d4cf-115a-4036-bbb2-12604aeae69f req-f1dd46a8-6055-45fc-b6f1-4ec6cf4a15c8 service nova] Enqueued Resource ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 with Priority: HIGHEST for action security_group_members [ 826.687593] env[69491]: INFO networking_nsxv3.common.synchronization [req-faf4d4cf-115a-4036-bbb2-12604aeae69f req-f1dd46a8-6055-45fc-b6f1-4ec6cf4a15c8 service nova] Enqueued Resource ID: f4a764d6-dec3-4e91-a665-43806392161f with Priority: HIGHEST for action port [ 826.687593] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 with Priority: HIGHEST for action security_group_rules [ 826.687593] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 with Priority: HIGHEST for action security_group_members [ 826.687593] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a764d6-dec3-4e91-a665-43806392161f with Priority: HIGHEST for action port [ 826.687593] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d4e738a-9dc2-4f83-b900-32903fbd0277 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.687593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.687593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.687593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.687593] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d4e738a-9dc2-4f83-b900-32903fbd0277',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.687593] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4e738a-9dc2-4f83-b900-32903fbd0277 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.687593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.688411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.688411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.688411] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.688411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.688411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.688411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.688745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.688745] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4e738a-9dc2-4f83-b900-32903fbd0277',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.689391] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4a764d6-dec3-4e91-a665-43806392161f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.689496] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4a764d6-dec3-4e91-a665-43806392161f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.689557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4a764d6-dec3-4e91-a665-43806392161f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.689705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4a764d6-dec3-4e91-a665-43806392161f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.689778] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4a764d6-dec3-4e91-a665-43806392161f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.112332] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 337bf73b-206c-43a7-940b-8771364a9da6 in Status: SUCCESS [ 827.112675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.112720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.112952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.113173] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.113296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.113360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.113516] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.113599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.113684] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.113834] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('337bf73b-206c-43a7-940b-8771364a9da6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.191890] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4e738a-9dc2-4f83-b900-32903fbd0277 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.192092] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.192327] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d4e738a-9dc2-4f83-b900-32903fbd0277',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.194282] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4a764d6-dec3-4e91-a665-43806392161f with status ACTIVE [ 827.194282] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.194282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.194282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.194282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.194644] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.194644] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.194644] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.194803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.194837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.195921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.195921] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.195921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.195921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.195921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.195921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.195921] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4a764d6-dec3-4e91-a665-43806392161f is going to be updated. [ 827.219140] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.219336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.219422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.219590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.219731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.219896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4a764d6-dec3-4e91-a665-43806392161f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.443800] env[69491]: INFO networking_nsxv3.common.synchronization [req-1ab5c0ce-3674-4d9a-a2e2-8e2ce2f5e92a req-6866f3a2-29b9-4824-a4d5-48a115b7b4c7 tempest-ServerMetadataNegativeTestJSON-59251184 tempest-ServerMetadataNegativeTestJSON-59251184-project-member] Enqueued Resource ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf with Priority: HIGHEST for action security_group_members [ 827.444408] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf with Priority: HIGHEST for action security_group_members [ 827.444705] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.444824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.444888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.448602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.448801] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.449120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.449120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.449224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.449298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.449433] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa2d8960-981d-4b66-be1b-51da4bb7f1cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.615865] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-337bf73b-206c-43a7-940b-8771364a9da6 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.616047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.616115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.616331] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.616496] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.616592] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.616653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.616795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.616885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.616971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.617129] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-337bf73b-206c-43a7-940b-8771364a9da6 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.617244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.617313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.617454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.617589] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.617691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.617831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.617977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.618064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.618147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.618234] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('337bf73b-206c-43a7-940b-8771364a9da6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.698103] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d4e738a-9dc2-4f83-b900-32903fbd0277',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.954113] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.954113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.954113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.954113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.954113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.954113] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.954428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.954428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.954428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.954527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.954586] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf already deleted. [ 827.954656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.978686] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b in Status: SUCCESS [ 827.978686] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.995590] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.996112] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.996388] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.996765] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.997187] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.997529] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.997899] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.998322] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.998587] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.998930] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.999244] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.999452] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.999653] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.999911] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.000133] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.000364] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.028831] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.029035] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 828.029202] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.029385] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.029792] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-b51355b7-2985-4705-b7ef-90a4147ea301 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.029996] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-b51355b7-2985-4705-b7ef-90a4147ea301" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.030895] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-b51355b7-2985-4705-b7ef-90a4147ea301" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.030895] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-b51355b7-2985-4705-b7ef-90a4147ea301" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.030895] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b51355b7-2985-4705-b7ef-90a4147ea301',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.124463] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 337bf73b-206c-43a7-940b-8771364a9da6: rpc.has_security_group_logging(os_id): False [ 828.145746] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.145982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.145982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.146265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.146363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.146745] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.146745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.146745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.147216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.147216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.147216] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.148338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.148338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.148338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.148338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.148338] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.148338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.148338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.148338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.148338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.148338] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 337bf73b-206c-43a7-940b-8771364a9da6 is going to be created. [ 828.202248] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.202248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.202248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.202248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.202248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.202248] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 is going to be created. [ 828.206546] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.206690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.206770] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.207834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.207834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.221477] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 337bf73b-206c-43a7-940b-8771364a9da6 in Status: IN_PROGRESS for 2s [ 828.245208] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.245208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.245208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.245208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.246397] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.268291] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 in Status: UNINITIALIZED for 2s [ 828.534178] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.534178] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.534178] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.534178] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.534178] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.534178] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port b51355b7-2985-4705-b7ef-90a4147ea301 not found, creating... [ 828.534499] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.534580] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.534729] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.534988] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.535175] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.535490] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.535690] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.535885] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.536230] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.536412] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.536584] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: b51355b7-2985-4705-b7ef-90a4147ea301 is going to be created. [ 828.564045] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.564045] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.564045] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.564045] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.564045] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.564045] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-b51355b7-2985-4705-b7ef-90a4147ea301" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.550012] env[69491]: INFO networking_nsxv3.common.synchronization [req-1ab5c0ce-3674-4d9a-a2e2-8e2ce2f5e92a req-27e330b9-7bf4-42c2-b292-38fe29f85903 service nova] Enqueued Resource ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf with Priority: HIGHEST for action security_group_rules [ 829.550295] env[69491]: INFO networking_nsxv3.common.synchronization [req-1ab5c0ce-3674-4d9a-a2e2-8e2ce2f5e92a req-27e330b9-7bf4-42c2-b292-38fe29f85903 service nova] Enqueued Resource ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf with Priority: HIGHEST for action security_group_members [ 829.550337] env[69491]: INFO networking_nsxv3.common.synchronization [req-1ab5c0ce-3674-4d9a-a2e2-8e2ce2f5e92a req-27e330b9-7bf4-42c2-b292-38fe29f85903 service nova] Enqueued Resource ID: b51355b7-2985-4705-b7ef-90a4147ea301 with Priority: HIGHEST for action port [ 829.550555] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf with Priority: HIGHEST for action security_group_rules [ 829.550682] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf with Priority: HIGHEST for action security_group_members [ 829.550785] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51355b7-2985-4705-b7ef-90a4147ea301 with Priority: HIGHEST for action port [ 829.551420] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa2d8960-981d-4b66-be1b-51da4bb7f1cf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.551814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.553720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.553991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.554130] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa2d8960-981d-4b66-be1b-51da4bb7f1cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.555439] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.555599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.555717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.555910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.556143] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.556199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.556244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.556392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.556477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.556838] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa2d8960-981d-4b66-be1b-51da4bb7f1cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.558088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b51355b7-2985-4705-b7ef-90a4147ea301 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.558088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b51355b7-2985-4705-b7ef-90a4147ea301" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.558183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b51355b7-2985-4705-b7ef-90a4147ea301" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.560147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b51355b7-2985-4705-b7ef-90a4147ea301" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.560147] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b51355b7-2985-4705-b7ef-90a4147ea301',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.064298] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.064298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.064298] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa2d8960-981d-4b66-be1b-51da4bb7f1cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.064298] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b51355b7-2985-4705-b7ef-90a4147ea301 with status ACTIVE [ 830.064298] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.064298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.064298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.064298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.064298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.064298] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.064298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.064298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.064298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.064298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.072437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.072437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.072437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.072437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.072437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.072437] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b51355b7-2985-4705-b7ef-90a4147ea301 is going to be updated. [ 830.095411] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.095587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.095649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.095849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.095989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.096165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b51355b7-2985-4705-b7ef-90a4147ea301" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.232278] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 337bf73b-206c-43a7-940b-8771364a9da6 in Status: SUCCESS [ 830.232441] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.278641] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 in Status: SUCCESS [ 830.278962] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.279194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.279472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.279792] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.280040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.280186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.280450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.281159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.281335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.281477] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d4e738a-9dc2-4f83-b900-32903fbd0277',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.573558] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa2d8960-981d-4b66-be1b-51da4bb7f1cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.633283] env[69491]: INFO networking_nsxv3.common.synchronization [req-25258f36-abad-4c5a-9b36-416458eac9ed req-1cdb16b4-7f05-46e9-955c-4514b37da3ab tempest-ServersAdminNegativeTestJSON-1852575205 tempest-ServersAdminNegativeTestJSON-1852575205-project-member] Enqueued Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_members [ 830.633874] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGHEST for action security_group_members [ 830.634214] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.634345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.634412] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.634616] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.634768] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.634868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.634934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.635994] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.636129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.636280] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.785032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4e738a-9dc2-4f83-b900-32903fbd0277 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.786030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.786139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.786304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.786511] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.786628] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.786702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.786869] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.786952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.787250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.787250] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4e738a-9dc2-4f83-b900-32903fbd0277 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.787369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.787369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.787501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.787635] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.787725] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.787784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.788000] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.788000] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.788103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.788211] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d4e738a-9dc2-4f83-b900-32903fbd0277',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.075676] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.075861] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.075954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.076195] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.076304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.076407] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf is going to be created. [ 831.103095] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.103255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.103328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.103633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.103816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.117308] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf in Status: UNINITIALIZED for 2s [ 831.139291] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.139516] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.139516] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.139816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.139816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.140099] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.140099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.140225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.140316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.140552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.140552] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 is going to be updated. [ 831.172782] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.172943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.173033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.173310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.173400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.192185] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: IN_PROGRESS for 2s [ 831.292719] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d4e738a-9dc2-4f83-b900-32903fbd0277: rpc.has_security_group_logging(os_id): False [ 831.315208] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.315372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.315599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.315717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.316078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.316356] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.316467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.316542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.316727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.316825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.317043] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.317149] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.317242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.317417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.317529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.317751] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.317852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.317909] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.318935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.318935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.318935] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 is going to be created. [ 831.379466] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.379466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.379466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.379466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.379466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.397309] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 in Status: IN_PROGRESS for 2s [ 832.028461] env[69491]: INFO networking_nsxv3.common.synchronization [req-1d2413e6-54cd-44a4-8606-123aa104ab84 req-c6a5dc02-82de-44c9-874e-4701646d03bf tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 832.029680] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 832.029680] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.029680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.029680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.030514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.030514] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.030514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.030514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.030514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.031099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.031099] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.369162] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-580 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.369162] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.369162] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.369162] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.369162] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.369162] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.369850] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.370154] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.370306] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.370514] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.370625] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.370732] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.370840] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.370986] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.371572] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.371768] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.394869] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.395052] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.395238] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.395665] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.396050] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-abacf1cb-1a7e-4339-b303-5bf7331e45af taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.396243] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.397165] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.397325] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.397366] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abacf1cb-1a7e-4339-b303-5bf7331e45af',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.536702] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.536890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.536963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.537583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.537676] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.537890] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.537986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.538082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.538256] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.538333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.538421] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be already deleted. [ 832.538501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.900459] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.900699] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.900852] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.901158] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.901317] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.901475] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port abacf1cb-1a7e-4339-b303-5bf7331e45af not found, creating... [ 832.901740] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.901901] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.902036] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.902280] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.902424] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.902723] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.902876] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.902994] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.905354] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.905851] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.905851] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: abacf1cb-1a7e-4339-b303-5bf7331e45af is going to be created. [ 832.954971] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.956248] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.956531] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.956941] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.957295] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.957612] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.131585] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf in Status: SUCCESS [ 833.132024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.132270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.132650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.133432] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.133612] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.133694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.133901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.133992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.134517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.134517] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa2d8960-981d-4b66-be1b-51da4bb7f1cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.203666] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 in Status: SUCCESS [ 833.203860] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 deletion is rescheduled due to dependency. [ 833.203976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.423433] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 in Status: SUCCESS [ 833.424097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.637356] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.637356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.637356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.637627] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.639082] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.639082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.639082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.639082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.639082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.639082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.639082] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.639082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.639082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.639082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.639082] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.639082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.639082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.639718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.639718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.639718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.639718] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa2d8960-981d-4b66-be1b-51da4bb7f1cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.673085] env[69491]: INFO networking_nsxv3.common.synchronization [req-1d2413e6-54cd-44a4-8606-123aa104ab84 req-8339cc7f-6355-470a-b2e4-4be8789ba475 service nova] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_rules [ 833.673300] env[69491]: INFO networking_nsxv3.common.synchronization [req-1d2413e6-54cd-44a4-8606-123aa104ab84 req-8339cc7f-6355-470a-b2e4-4be8789ba475 service nova] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 833.673409] env[69491]: INFO networking_nsxv3.common.synchronization [req-1d2413e6-54cd-44a4-8606-123aa104ab84 req-8339cc7f-6355-470a-b2e4-4be8789ba475 service nova] Enqueued Resource ID: abacf1cb-1a7e-4339-b303-5bf7331e45af with Priority: HIGHEST for action port [ 833.673862] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_rules [ 833.673997] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 833.674107] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abacf1cb-1a7e-4339-b303-5bf7331e45af with Priority: HIGHEST for action port [ 833.674369] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.674484] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.674549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.674798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.674878] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.676026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.676190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.676280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.676479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.678129] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.678129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.678129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.678129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.678129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.678129] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.678504] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-abacf1cb-1a7e-4339-b303-5bf7331e45af taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.679672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.679672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.679672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.679672] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abacf1cb-1a7e-4339-b303-5bf7331e45af',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.146718] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa2d8960-981d-4b66-be1b-51da4bb7f1cf: rpc.has_security_group_logging(os_id): False [ 834.166730] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.166874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.166923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.168035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.168035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.168035] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.168035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.168035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.168320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.168400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.169084] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.169313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.169375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.169593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.169784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.170069] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.170244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.170350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.170960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.170960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.170960] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf is going to be created. [ 834.181492] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.181681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.181964] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.183223] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abacf1cb-1a7e-4339-b303-5bf7331e45af with status ACTIVE [ 834.183718] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.183718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.183875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.184147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.184982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.184982] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.184982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.184982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.184982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.184982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.185350] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.185350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.185425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.185567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.185643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.186048] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abacf1cb-1a7e-4339-b303-5bf7331e45af is going to be updated. [ 834.211423] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.211423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.211547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.212139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.212139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.212139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.246647] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.246862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.246903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.247568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.247568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.261581] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf in Status: IN_PROGRESS for 2s [ 834.687829] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.859678] env[69491]: INFO networking_nsxv3.common.synchronization [req-8d62377e-6f33-4ab6-9708-61a0c8c4419e req-0126a513-e86d-433a-a58a-2bbaf5fe8231 tempest-ServerActionsV293TestJSON-872204216 tempest-ServerActionsV293TestJSON-872204216-project-member] Enqueued Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGHEST for action security_group_members [ 834.860252] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGHEST for action security_group_members [ 834.860566] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c9d4b0f-923e-4454-badc-cbd5c63e211f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.860694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.860762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.861271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.861431] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.861539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.861604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.861774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.861857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.861952] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c9d4b0f-923e-4454-badc-cbd5c63e211f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.190667] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.191226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.191226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.191226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.191410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.191410] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be created. [ 835.217682] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.217845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.217912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.218708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.218708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.240933] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.241302] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-287" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.241895] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-287" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.241895] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-287" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.242232] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.242553] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.242553] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.243942] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.243942] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.244167] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.244289] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.244399] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.244508] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.244620] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.244769] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.244857] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.248662] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: UNINITIALIZED for 2s [ 835.251149] env[69491]: INFO networking_nsxv3.common.synchronization [req-2b028acd-83bb-41b4-a65d-83e48d38a9e5 req-e27795a7-510a-49e4-bef9-a7358268556f tempest-ServerPasswordTestJSON-37813558 tempest-ServerPasswordTestJSON-37813558-project-member] Enqueued Resource ID: 337bf73b-206c-43a7-940b-8771364a9da6 with Priority: HIGHEST for action security_group_members [ 835.251865] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 337bf73b-206c-43a7-940b-8771364a9da6 with Priority: HIGHEST for action security_group_members [ 835.252222] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-337bf73b-206c-43a7-940b-8771364a9da6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.252563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.252692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.252891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.253065] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.253230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.253267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.253432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.253965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.253965] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('337bf73b-206c-43a7-940b-8771364a9da6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.266309] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.266309] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.266309] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.266309] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-287" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.266510] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-1c5870fd-6686-4b50-8e04-67a07ff32da3 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.266747] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-1c5870fd-6686-4b50-8e04-67a07ff32da3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.266962] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-1c5870fd-6686-4b50-8e04-67a07ff32da3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.268029] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-1c5870fd-6686-4b50-8e04-67a07ff32da3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.268029] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c5870fd-6686-4b50-8e04-67a07ff32da3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.364954] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.365224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.365352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.365677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.365830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.366149] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.366248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.366336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.366552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.366661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.366772] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f already deleted. [ 835.366877] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.758714] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.759264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.759264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.759264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.759264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.759674] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.759674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.759674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.759807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.759842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.759930] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 337bf73b-206c-43a7-940b-8771364a9da6 is going to be updated. [ 835.771453] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.771453] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.771453] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.771453] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.771453] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.771453] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 1c5870fd-6686-4b50-8e04-67a07ff32da3 not found, creating... [ 835.771453] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.771453] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.771453] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.771453] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.771862] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.771862] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.772078] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.773511] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.773736] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.773882] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.774853] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 1c5870fd-6686-4b50-8e04-67a07ff32da3 is going to be created. [ 835.809861] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.810084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.810124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.810391] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.810604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.812868] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.813128] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.813285] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.813618] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.813870] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.814410] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-1c5870fd-6686-4b50-8e04-67a07ff32da3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.828784] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 337bf73b-206c-43a7-940b-8771364a9da6 in Status: IN_PROGRESS for 2s [ 836.287074] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf in Status: SUCCESS [ 836.287467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.563612] env[69491]: INFO networking_nsxv3.common.synchronization [req-8d62377e-6f33-4ab6-9708-61a0c8c4419e req-08adceb5-6b9e-4120-89bf-6f1c6cc62106 service nova] Enqueued Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGHEST for action security_group_rules [ 836.563612] env[69491]: INFO networking_nsxv3.common.synchronization [req-8d62377e-6f33-4ab6-9708-61a0c8c4419e req-08adceb5-6b9e-4120-89bf-6f1c6cc62106 service nova] Enqueued Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGHEST for action security_group_members [ 836.563612] env[69491]: INFO networking_nsxv3.common.synchronization [req-8d62377e-6f33-4ab6-9708-61a0c8c4419e req-08adceb5-6b9e-4120-89bf-6f1c6cc62106 service nova] Enqueued Resource ID: 1c5870fd-6686-4b50-8e04-67a07ff32da3 with Priority: HIGHEST for action port [ 836.563612] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGHEST for action security_group_rules [ 836.563802] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGHEST for action security_group_members [ 836.563802] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c5870fd-6686-4b50-8e04-67a07ff32da3 with Priority: HIGHEST for action port [ 836.564304] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.564304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.564798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.564798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.564798] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c9d4b0f-923e-4454-badc-cbd5c63e211f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.566828] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c9d4b0f-923e-4454-badc-cbd5c63e211f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.566828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.566828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.566828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.566828] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.567521] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.567521] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.567521] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.567521] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.567521] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c9d4b0f-923e-4454-badc-cbd5c63e211f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.568741] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c5870fd-6686-4b50-8e04-67a07ff32da3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.568741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c5870fd-6686-4b50-8e04-67a07ff32da3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.568741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c5870fd-6686-4b50-8e04-67a07ff32da3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.568899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c5870fd-6686-4b50-8e04-67a07ff32da3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.568931] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c5870fd-6686-4b50-8e04-67a07ff32da3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.071367] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c9d4b0f-923e-4454-badc-cbd5c63e211f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.072408] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c9d4b0f-923e-4454-badc-cbd5c63e211f taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.072541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.072678] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c5870fd-6686-4b50-8e04-67a07ff32da3 with status ACTIVE [ 837.073040] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.073040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.073040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.073217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.073309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.073496] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.073591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.073654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.073805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.073883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.078023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.078023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.078023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.078023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.078023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.078023] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c5870fd-6686-4b50-8e04-67a07ff32da3 is going to be updated. [ 837.097136] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.097290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.097360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.097572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.097709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.097870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c5870fd-6686-4b50-8e04-67a07ff32da3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.259890] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 837.260214] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.260395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.260623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.260816] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.260937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.261010] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.261256] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.261337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.261423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.261513] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.577555] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c9d4b0f-923e-4454-badc-cbd5c63e211f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.674084] env[69491]: INFO networking_nsxv3.common.synchronization [req-8016d9bd-99e1-4da6-b7a7-bea56e5c229a req-93532d56-4942-4c09-82a8-a24a57dd0f4e tempest-ServerDiskConfigTestJSON-964931906 tempest-ServerDiskConfigTestJSON-964931906-project-member] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 837.674655] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 837.674996] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.675218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.675352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.675629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.675816] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.675947] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.676044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.676235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.676391] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.676524] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.764093] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.764320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.764467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.764669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.764854] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.764948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.765051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.765257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.765337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.765438] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.765598] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.765710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.765774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.765934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.766635] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.766749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.769372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.769607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.769749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.769850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.769982] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.839454] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 337bf73b-206c-43a7-940b-8771364a9da6 in Status: SUCCESS [ 837.839632] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 337bf73b-206c-43a7-940b-8771364a9da6 deletion is rescheduled due to dependency. [ 837.839773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.028780] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-956 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.028903] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.029081] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.029394] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.029651] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.030503] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.030503] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.030503] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.030503] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.030681] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.030681] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.030785] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.030897] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.031061] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.031185] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.031331] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.051280] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.051882] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 838.051882] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.052043] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.052493] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-30949201-113d-425a-b90d-8ae690e65b8a taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.052620] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-30949201-113d-425a-b90d-8ae690e65b8a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.052685] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-30949201-113d-425a-b90d-8ae690e65b8a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.053027] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-30949201-113d-425a-b90d-8ae690e65b8a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.053174] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30949201-113d-425a-b90d-8ae690e65b8a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.083981] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.083981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.083981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.083981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.083981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.083981] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f is going to be created. [ 838.114018] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.114018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.114018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.114018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.114018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.126777] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f in Status: UNINITIALIZED for 2s [ 838.180913] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.181121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.181947] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.182367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.182480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.182712] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.182824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.182885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.183118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.183256] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.183374] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 838.239234] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.239234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.239234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.239234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.239234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.254145] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 838.279281] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaa139e8-f09f-4a46-897a-d481019a63be: rpc.has_security_group_logging(os_id): False [ 838.309792] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.309792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.309792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.310021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.310115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.310372] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.310549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.310549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.310755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.310799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.310988] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.311269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.311269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.311476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.311556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.311750] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.311881] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.312447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.312447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.312447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.312447] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be created. [ 838.414082] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.414244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.414626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.414626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.414761] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.435881] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 838.556748] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.556934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.559313] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.559732] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.560035] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.560418] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 30949201-113d-425a-b90d-8ae690e65b8a not found, creating... [ 838.560703] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.561554] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.561554] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.561709] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.561784] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.562126] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.562309] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.564730] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.564730] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.564885] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.565032] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 30949201-113d-425a-b90d-8ae690e65b8a is going to be created. [ 838.600407] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.600806] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.600806] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.601144] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.601638] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.601777] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-30949201-113d-425a-b90d-8ae690e65b8a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.363473] env[69491]: INFO networking_nsxv3.common.synchronization [req-8016d9bd-99e1-4da6-b7a7-bea56e5c229a req-58356440-26b4-4750-ad19-cde4d59101c1 service nova] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_rules [ 839.363473] env[69491]: INFO networking_nsxv3.common.synchronization [req-8016d9bd-99e1-4da6-b7a7-bea56e5c229a req-58356440-26b4-4750-ad19-cde4d59101c1 service nova] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 839.363591] env[69491]: INFO networking_nsxv3.common.synchronization [req-8016d9bd-99e1-4da6-b7a7-bea56e5c229a req-58356440-26b4-4750-ad19-cde4d59101c1 service nova] Enqueued Resource ID: 30949201-113d-425a-b90d-8ae690e65b8a with Priority: HIGHEST for action port [ 839.366039] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_rules [ 839.366039] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 839.366039] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30949201-113d-425a-b90d-8ae690e65b8a with Priority: HIGHEST for action port [ 839.366039] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.366039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.366039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.366039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.366039] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.367225] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.367225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.367225] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-30949201-113d-425a-b90d-8ae690e65b8a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.367225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30949201-113d-425a-b90d-8ae690e65b8a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.367225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30949201-113d-425a-b90d-8ae690e65b8a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.367225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30949201-113d-425a-b90d-8ae690e65b8a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.367225] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30949201-113d-425a-b90d-8ae690e65b8a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.603681] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.604172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.604172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.604172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.604446] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.725345] env[69491]: INFO networking_nsxv3.common.synchronization [req-2a5213e1-2a0b-4938-b695-3c72f28e7f4c req-d8c3683d-9e28-4c38-826a-16d51b52bc9b tempest-ServerMetadataTestJSON-530440074 tempest-ServerMetadataTestJSON-530440074-project-member] Enqueued Resource ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 with Priority: HIGHEST for action security_group_members [ 839.728344] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 with Priority: HIGHEST for action security_group_members [ 839.728344] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4e738a-9dc2-4f83-b900-32903fbd0277 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.728344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.728344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.728344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.728344] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.728344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.728344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.728344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.728344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.728344] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4e738a-9dc2-4f83-b900-32903fbd0277',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.868393] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.868589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.868759] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30949201-113d-425a-b90d-8ae690e65b8a with status ACTIVE [ 839.868934] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.869078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.869144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.869356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.869449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.869624] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.869722] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.869785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.869963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.870020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.870221] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.870318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.870379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.870523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.870595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.870679] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30949201-113d-425a-b90d-8ae690e65b8a is going to be updated. [ 839.895821] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.895821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.895821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.895821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.895821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.895821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30949201-113d-425a-b90d-8ae690e65b8a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.108032] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.139148] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f in Status: SUCCESS [ 840.139450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.140079] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.140361] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.140662] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.140824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.140824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.140995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.141382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.141382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.141382] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c9d4b0f-923e-4454-badc-cbd5c63e211f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.232029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.233512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.233512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.233512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.233512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.233512] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.233512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.233512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.233512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.234236] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.234236] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 is going to be updated. [ 840.265783] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 840.265783] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff deletion is rescheduled due to dependency. [ 840.265783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.265783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.265962] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.266178] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.266309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.266366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.266537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.266621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.266721] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.278114] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.278114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.278114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.278462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.278552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.290040] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 in Status: IN_PROGRESS for 2s [ 840.452113] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 840.452113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.611872] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.644540] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c9d4b0f-923e-4454-badc-cbd5c63e211f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.714872] env[69491]: INFO networking_nsxv3.common.synchronization [req-abc72900-f041-40ef-a6dc-0b086662cfe2 req-a20c388e-80fb-470f-ad84-7d6ef049f7b0 tempest-ServersAdminTestJSON-362478418 tempest-ServersAdminTestJSON-362478418-project-member] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 840.714872] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 840.714872] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.714872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.714872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.714872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.715245] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.715245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.715245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.715362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.715408] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.715555] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.771297] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.117614] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 841.118073] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 841.134628] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.134628] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.134628] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.135296] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.135730] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.136065] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.136310] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.136856] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.137148] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.137489] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.137736] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.137944] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.138166] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.138388] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.138598] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.138834] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.147755] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c9d4b0f-923e-4454-badc-cbd5c63e211f: rpc.has_security_group_logging(os_id): False [ 841.162873] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.163071] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 841.163219] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.163387] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.163852] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-b9d23c88-4472-4d8e-b0a4-2f841622f367 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.164018] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-b9d23c88-4472-4d8e-b0a4-2f841622f367" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.164695] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-b9d23c88-4472-4d8e-b0a4-2f841622f367" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.164695] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-b9d23c88-4472-4d8e-b0a4-2f841622f367" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.164695] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9d23c88-4472-4d8e-b0a4-2f841622f367',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.180589] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.180791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.180917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.181081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.181245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.181472] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.181571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.181639] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.181822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.181890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.181967] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f is going to be created. [ 841.221034] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.221034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.221034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.221034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.221034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.221404] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.221404] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.221404] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.221517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.221570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.221662] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 already deleted. [ 841.221744] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.277627] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.287436] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.287595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.287670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.287901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.288124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.302335] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f in Status: IN_PROGRESS for 2s [ 841.672111] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.672539] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.672539] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.672912] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.672976] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.675355] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port b9d23c88-4472-4d8e-b0a4-2f841622f367 not found, creating... [ 841.675737] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.675944] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.677533] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.677533] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.677533] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.677533] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.677533] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.677533] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.677533] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.677533] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.678061] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: b9d23c88-4472-4d8e-b0a4-2f841622f367 is going to be created. [ 841.721477] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.722118] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.722573] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.726908] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.726908] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.726908] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-b9d23c88-4472-4d8e-b0a4-2f841622f367" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.781929] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.782216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.782386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.782712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.782820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.782938] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 841.821580] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.823023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.823023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.823023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.823023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.840963] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 842.303315] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 in Status: SUCCESS [ 842.303575] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 deletion is rescheduled due to dependency. [ 842.303718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.392893] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.394873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.394873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.394873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.412273] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 842.413539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.415219] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 842.449806] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.450213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.450827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.450827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.462602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.463665] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 842.464337] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 842.464523] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 842.512551] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.512800] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.512952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.513312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.515481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.515992] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 842.643369] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.643634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.643839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.644546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.644546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.644913] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 842.701892] env[69491]: INFO networking_nsxv3.common.synchronization [req-abc72900-f041-40ef-a6dc-0b086662cfe2 req-4cc47ab0-16cd-4077-81b0-8a95d937c767 service nova] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_rules [ 842.703707] env[69491]: INFO networking_nsxv3.common.synchronization [req-abc72900-f041-40ef-a6dc-0b086662cfe2 req-4cc47ab0-16cd-4077-81b0-8a95d937c767 service nova] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 842.704181] env[69491]: INFO networking_nsxv3.common.synchronization [req-abc72900-f041-40ef-a6dc-0b086662cfe2 req-4cc47ab0-16cd-4077-81b0-8a95d937c767 service nova] Enqueued Resource ID: b9d23c88-4472-4d8e-b0a4-2f841622f367 with Priority: HIGHEST for action port [ 842.704577] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_rules [ 842.704717] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 842.704811] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d23c88-4472-4d8e-b0a4-2f841622f367 with Priority: HIGHEST for action port [ 842.705113] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.705242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.705360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.705652] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.705736] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.709479] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.709479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.709479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.709479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.709479] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.709479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.709479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.709479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.709479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.709479] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.710032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9d23c88-4472-4d8e-b0a4-2f841622f367 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.710199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9d23c88-4472-4d8e-b0a4-2f841622f367" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.710199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9d23c88-4472-4d8e-b0a4-2f841622f367" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.710413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9d23c88-4472-4d8e-b0a4-2f841622f367" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.710456] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9d23c88-4472-4d8e-b0a4-2f841622f367',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.720252] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.720252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.720252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.720526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.720592] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.720864] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 842.720961] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'415ca665-bf4f-490e-98cb-4ba509031109', 'fafd77cc-d50d-41af-b588-6629e9cea514', '62c4aff5-ba77-43c8-9eb6-a56da143180b', '24376446-4b3c-421b-a079-0ca7bece8e3b', '7fc273f1-5898-4eda-a720-1bca483a33b9', '378e4251-ff58-4c11-81e0-57e7d2509426', '0454f817-e35d-4717-870f-6288650eae31', '06871947-bfe0-4792-9f13-39942cbccdf7', 'ab7773f0-7815-4a45-bf15-8a8079aa86ff', 'd72c0d6b-219d-45d0-992a-5e67f5d6c827', '8d4e738a-9dc2-4f83-b900-32903fbd0277', '9632268c-db1a-4548-9652-b638bc84b886', 'aa2d8960-981d-4b66-be1b-51da4bb7f1cf', 'd4084412-2aca-4bc0-a15c-1690668e51ea', '53902bde-30e4-44b3-9472-853fecdeacca', 'b70dddfb-485a-4313-8569-7ab012c8dc7e', 'f0db36d0-bbf1-4643-8661-68a84fdee418', '6fd20800-5a4b-495c-a02a-35b10f00ea55', 'de4976ed-85d7-4836-b6cb-a96b2293c655', 'd5373a4c-17ac-4e15-86d8-6cc9c15a4f3f', '36f74a30-d3ec-48c5-8573-1f7852cad1f9', '00540613-7092-4498-a250-9bb6d721591a', '8d5a33a2-cab9-4479-9d1c-125f032b265a', '88118802-dd47-4c99-a6fd-7180a306f792', 'c9023993-36fc-47c8-9c97-1eea2e87c7cf', '337bf73b-206c-43a7-940b-8771364a9da6', 'eaa139e8-f09f-4a46-897a-d481019a63be', 'f5d9b441-54c3-4ef0-8866-aee0f17f0fb9', '9028d23d-9b03-48da-a060-d720486e9412', '57178755-8937-4ec8-907c-6e349b3947d2', '8c9d4b0f-923e-4454-badc-cbd5c63e211f', '8c5808a0-5aae-42f0-89ec-a7d1d00bc588', 'f1812f0f-128b-41f6-987e-18e589d1ef41', '745f6209-d9d3-480b-9445-604b9585bfe0', '5f6ef41a-5e03-4f6b-8b59-b1f729f165d1'} {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 842.721065] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 842.745484] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.745637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.745711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.745940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.746049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.746166] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 842.746240] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 842.746313] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 842.846668] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.846668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.846668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.846871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.848041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.848041] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 842.848041] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 842.848266] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 842.848266] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 842.848266] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 842.848266] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGH for action security_group_rules [ 842.848461] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGH for action security_group_rules [ 842.848461] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGH for action security_group_rules [ 842.848568] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24376446-4b3c-421b-a079-0ca7bece8e3b with Priority: HIGH for action security_group_rules [ 842.848568] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 with Priority: HIGH for action security_group_rules [ 842.848679] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 378e4251-ff58-4c11-81e0-57e7d2509426 with Priority: HIGH for action security_group_rules [ 842.848737] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGH for action security_group_rules [ 842.848788] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGH for action security_group_rules [ 842.848848] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGH for action security_group_rules [ 842.848912] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 with Priority: HIGH for action security_group_rules [ 842.848969] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 with Priority: HIGH for action security_group_rules [ 842.849049] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGH for action security_group_rules [ 842.849109] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf with Priority: HIGH for action security_group_rules [ 842.849193] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGH for action security_group_rules [ 842.849245] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGH for action security_group_rules [ 842.849310] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGH for action security_group_rules [ 842.849372] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0db36d0-bbf1-4643-8661-68a84fdee418 with Priority: HIGH for action security_group_rules [ 842.849435] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGH for action security_group_rules [ 842.849492] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGH for action security_group_rules [ 842.849549] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f with Priority: HIGH for action security_group_rules [ 842.849648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.211763] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.213088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.213202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.217161] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9d23c88-4472-4d8e-b0a4-2f841622f367 with status ACTIVE [ 843.217517] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.217798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.218729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.218729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.218729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.218729] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.218729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.218729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.219050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.219050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.219050] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.219192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.219192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.220928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.220928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.220928] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9d23c88-4472-4d8e-b0a4-2f841622f367 is going to be updated. [ 843.255217] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.255413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.255512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.255728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.255876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.256096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9d23c88-4472-4d8e-b0a4-2f841622f367" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.317507] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f in Status: SUCCESS [ 843.317507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.714327] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.852747] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 843.853059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.853176] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.853403] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.853604] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.853745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.853814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.853975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.854070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.854158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.854254] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.219984] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.220160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.220286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.220665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.220777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.220868] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be created. [ 844.250300] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.250539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.250539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.250725] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.250885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.261315] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: UNINITIALIZED for 2s [ 844.349758] env[69491]: INFO networking_nsxv3.common.synchronization [req-4fd4011e-5f99-4fe2-8276-040f66cbec34 req-9a22185e-195b-481c-9b91-828b61b513e3 tempest-ServerMetadataNegativeTestJSON-59251184 tempest-ServerMetadataNegativeTestJSON-59251184-project-member] Enqueued Resource ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf with Priority: HIGHEST for action security_group_members [ 844.350372] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf with Priority: HIGHEST for action security_group_members [ 844.350589] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGH for action security_group_rules [ 844.350655] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGH for action security_group_rules [ 844.350726] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0454f817-e35d-4717-870f-6288650eae31 with Priority: HIGH for action security_group_rules [ 844.350825] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGH for action security_group_rules [ 844.350918] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f with Priority: HIGH for action security_group_rules [ 844.351018] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGH for action security_group_rules [ 844.351114] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGH for action security_group_rules [ 844.351205] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0db36d0-bbf1-4643-8661-68a84fdee418 with Priority: HIGH for action security_group_rules [ 844.351364] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGH for action security_group_rules [ 844.351480] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70dddfb-485a-4313-8569-7ab012c8dc7e with Priority: HIGH for action security_group_rules [ 844.351589] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf with Priority: HIGH for action security_group_rules [ 844.351702] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGH for action security_group_rules [ 844.351798] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 with Priority: HIGH for action security_group_rules [ 844.351888] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 with Priority: HIGH for action security_group_rules [ 844.351977] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGH for action security_group_rules [ 844.352077] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378e4251-ff58-4c11-81e0-57e7d2509426 with Priority: HIGH for action security_group_rules [ 844.352166] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGH for action security_group_rules [ 844.352252] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 with Priority: HIGH for action security_group_rules [ 844.352387] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGH for action security_group_rules [ 844.352523] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24376446-4b3c-421b-a079-0ca7bece8e3b with Priority: HIGH for action security_group_rules [ 844.352833] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.352989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.353082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.353345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.353458] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.353567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.353640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.353784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.353867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.353961] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa2d8960-981d-4b66-be1b-51da4bb7f1cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.356360] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.356532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.356532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.356752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.357050] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.357953] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62c4aff5-ba77-43c8-9eb6-a56da143180b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.358085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.358159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.358323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.358424] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.359703] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0454f817-e35d-4717-870f-6288650eae31 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.359835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.359877] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.360151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.360250] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0454f817-e35d-4717-870f-6288650eae31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.361578] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.361706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.361706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.362158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.362158] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.362911] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.363046] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.363132] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.363285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.363361] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.365166] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de4976ed-85d7-4836-b6cb-a96b2293c655 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.365255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.365311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.365506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.365556] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.366953] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.367087] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.367139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.367289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.367364] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.368229] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0db36d0-bbf1-4643-8661-68a84fdee418 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.368341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.368410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.368561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.368643] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0db36d0-bbf1-4643-8661-68a84fdee418',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.369496] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4084412-2aca-4bc0-a15c-1690668e51ea taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.369605] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.369671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.369819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.369891] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.370124] env[69491]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 844.371383] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b70dddfb-485a-4313-8569-7ab012c8dc7e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.371497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.371564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.371714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.372057] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b70dddfb-485a-4313-8569-7ab012c8dc7e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.372883] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa2d8960-981d-4b66-be1b-51da4bb7f1cf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.372990] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.373071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.373221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.373293] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa2d8960-981d-4b66-be1b-51da4bb7f1cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.374096] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.374205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.374267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.374623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.374623] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.375276] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d4e738a-9dc2-4f83-b900-32903fbd0277 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.375386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.375454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.375604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.375676] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d4e738a-9dc2-4f83-b900-32903fbd0277',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.376574] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d72c0d6b-219d-45d0-992a-5e67f5d6c827 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.376686] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.376753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.377527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.377630] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d72c0d6b-219d-45d0-992a-5e67f5d6c827',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.378463] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.378577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.378787] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-378e4251-ff58-4c11-81e0-57e7d2509426 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.378893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.378958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.379162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.379239] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('378e4251-ff58-4c11-81e0-57e7d2509426',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.380075] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.380192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.380261] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.380413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.380501] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.382351] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fc273f1-5898-4eda-a720-1bca483a33b9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.382494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.382566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.382725] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.382804] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fc273f1-5898-4eda-a720-1bca483a33b9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.383646] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.383753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.383820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.383984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.384071] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.384987] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24376446-4b3c-421b-a079-0ca7bece8e3b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.385116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.385186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.385338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.385413] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24376446-4b3c-421b-a079-0ca7bece8e3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.385625] env[69491]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 844.391057] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.391184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.391248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.391443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.391630] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.391739] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.391806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.391956] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.392069] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.392159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.392309] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.392413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.392492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.392653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.392799] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.392895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.392957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.394029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.394029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.394029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.394029] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.857490] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.857911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.857911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.858023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.878112] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.878344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.879704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.879952] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.880248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.880248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.880405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.880491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.880587] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf is going to be updated. [ 844.881652] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.881847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.887865] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.887970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.888046] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.888226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.888394] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.888494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.888577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.888744] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.888821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.888910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.888999] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.891156] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-62c4aff5-ba77-43c8-9eb6-a56da143180b taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.891353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.891353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.891544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.891701] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.891810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.891868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.892086] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.892086] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.892200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.892256] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.897751] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab7773f0-7815-4a45-bf15-8a8079aa86ff: rpc.has_security_group_logging(os_id): False [ 844.908457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.908611] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0454f817-e35d-4717-870f-6288650eae31 is going to be deleted. [ 844.912910] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.913090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.913148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.913362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.916369] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.916515] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.916570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.916755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.916897] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.929351] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4084412-2aca-4bc0-a15c-1690668e51ea taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.929690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.929690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.929690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.929894] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.929971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.930034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.930162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.930248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.930337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.930427] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.931413] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.931560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.931625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.931782] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.931933] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.932060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.932118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.932257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.932359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.932453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.932538] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.938967] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf in Status: IN_PROGRESS for 2s [ 844.940206] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.940400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.943017] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.943017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.943017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.943225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.943400] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.943502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.943564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.943721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.943803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.943888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.943976] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.948768] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.948939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.948939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.949147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.949339] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.949474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.949560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.949729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.949810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.949914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.950050] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.952613] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4976ed-85d7-4836-b6cb-a96b2293c655 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.952767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.952837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.953019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.953220] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.953317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.953417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.953849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.953849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.953964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.954051] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.957137] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.958569] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.958703] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.958787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.959041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.959216] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.959325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.959403] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.959546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.959632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.959792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.959866] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.959958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.960029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.960218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.960378] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.960514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.960584] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.960729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.960829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.960923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.961017] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.963920] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.966031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.966579] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be deleted. [ 844.971683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.971806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.985945] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06871947-bfe0-4792-9f13-39942cbccdf7: rpc.has_security_group_logging(os_id): False [ 844.996032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.996032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.018774] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.018973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.020367] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.020511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.021479] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.021594] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.022362] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.022472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.023270] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.023387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.024299] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.024407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.025217] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.025370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.026129] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.026247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.027029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.027143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.027866] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 845.028423] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.028555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.029426] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 845.029749] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.029858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.031341] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 845.031757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.031959] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.034396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.034396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.034396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.034396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.034396] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.034396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.034396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.034396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.034396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.034396] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.034396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.034396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.034396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.034396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.034396] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 845.035038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.035038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.035038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.035183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0454f817-e35d-4717-870f-6288650eae31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.036068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.036250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.036250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.036471] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf is going to be deleted. [ 845.038027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.038027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.077364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.077547] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0db36d0-bbf1-4643-8661-68a84fdee418 is going to be deleted. [ 845.078717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.078952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.106324] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.106324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.120048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.120048] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fc273f1-5898-4eda-a720-1bca483a33b9 is going to be deleted. [ 845.121080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.121349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.179763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.179763] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24376446-4b3c-421b-a079-0ca7bece8e3b is going to be deleted. [ 845.180333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.180572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.198769] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.198973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.202024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.202024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.204673] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.204909] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.243601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.243780] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d4e738a-9dc2-4f83-b900-32903fbd0277 is going to be deleted. [ 845.244790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.245023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.270153] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.270376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.297295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.297295] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be deleted. [ 845.297295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.297295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.338197] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.338197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.345049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.345049] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b70dddfb-485a-4313-8569-7ab012c8dc7e is going to be deleted. [ 845.345259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.345440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.388136] env[69491]: INFO networking_nsxv3.common.synchronization [req-7c87aea4-92af-4623-a8b1-892075e78047 req-38f9cad6-c86c-4c2e-8b0e-6bd614645c48 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_members [ 845.388338] env[69491]: INFO networking_nsxv3.common.synchronization [req-7c87aea4-92af-4623-a8b1-892075e78047 req-38f9cad6-c86c-4c2e-8b0e-6bd614645c48 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 845.388905] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_members [ 845.389057] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 845.389368] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.389520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.389574] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.389875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.390050] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.390550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.390550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.390550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.390550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.390550] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.391616] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.391616] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.391784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.392073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.392292] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.392567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.392567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.392567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.392681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.392815] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.394194] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.395007] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.426885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.427132] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 378e4251-ff58-4c11-81e0-57e7d2509426 is going to be deleted. [ 845.429373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.429373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.454622] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.454622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.458456] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.458640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.460773] env[69491]: INFO networking_nsxv3.common.synchronization [req-7c87aea4-92af-4623-a8b1-892075e78047 req-38f9cad6-c86c-4c2e-8b0e-6bd614645c48 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_rules [ 845.461251] env[69491]: INFO networking_nsxv3.common.synchronization [req-7c87aea4-92af-4623-a8b1-892075e78047 req-38f9cad6-c86c-4c2e-8b0e-6bd614645c48 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_members [ 845.461580] env[69491]: INFO networking_nsxv3.common.synchronization [req-7c87aea4-92af-4623-a8b1-892075e78047 req-38f9cad6-c86c-4c2e-8b0e-6bd614645c48 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_rules [ 845.462121] env[69491]: INFO networking_nsxv3.common.synchronization [req-7c87aea4-92af-4623-a8b1-892075e78047 req-38f9cad6-c86c-4c2e-8b0e-6bd614645c48 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 845.462583] env[69491]: INFO networking_nsxv3.common.synchronization [req-7c87aea4-92af-4623-a8b1-892075e78047 req-38f9cad6-c86c-4c2e-8b0e-6bd614645c48 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: abacf1cb-1a7e-4339-b303-5bf7331e45af with Priority: HIGHEST for action port [ 845.463983] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_rules [ 845.464265] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_rules [ 845.464385] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abacf1cb-1a7e-4339-b303-5bf7331e45af with Priority: HIGHEST for action port [ 845.464540] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_members [ 845.464675] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 845.464977] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.466114] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.466353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.466917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.467373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.473721] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.473721] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.473721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.473721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.473721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.473721] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.473721] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-abacf1cb-1a7e-4339-b303-5bf7331e45af taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.473721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.473721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.473721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.474161] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abacf1cb-1a7e-4339-b303-5bf7331e45af',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.474821] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.474930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.475121] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.475199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.478266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.479031] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f is going to be deleted. [ 845.483066] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.483811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.483811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.483811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.483811] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.483811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.483811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.484138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.484138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.484138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.486141] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.486141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.486141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.486141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.486141] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.486141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.486141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.486141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.486610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.486610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.486610] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.488840] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fd20800-5a4b-495c-a02a-35b10f00ea55: rpc.has_security_group_logging(os_id): False [ 845.489654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.489872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.492540] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4084412-2aca-4bc0-a15c-1690668e51ea: rpc.has_security_group_logging(os_id): False [ 845.526042] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.526042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.535843] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.536060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.536461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.536708] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.536827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.536891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.537126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.537212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.537431] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.537557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.537625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.537805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.537904] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.538171] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.538295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.538417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.538620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.538720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.538852] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06871947-bfe0-4792-9f13-39942cbccdf7 is going to be updated. [ 845.540188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.540393] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.542621] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.542779] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.612908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.613078] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d72c0d6b-219d-45d0-992a-5e67f5d6c827 is going to be deleted. [ 845.614137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.614369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.614468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.614623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0db36d0-bbf1-4643-8661-68a84fdee418" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.614791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.615086] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.615086] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.615186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.616332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.616332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.616509] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.617629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.617825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.617907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.618036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fc273f1-5898-4eda-a720-1bca483a33b9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.618197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.618347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.618423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.618531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24376446-4b3c-421b-a079-0ca7bece8e3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.619068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.619302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.619422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.619548] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d4e738a-9dc2-4f83-b900-32903fbd0277" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.619698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.619829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.619904] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.620026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.621401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.621401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.630601] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.630601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.656883] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 845.664489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.667020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.667020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.667020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.667020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.667020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.667020] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 845.668682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.668884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.697807] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.697981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.731227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.731227] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.731227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.731227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.731227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.731227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.731227] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4084412-2aca-4bc0-a15c-1690668e51ea is going to be updated. [ 845.731918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.732146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.732233] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.732449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b70dddfb-485a-4313-8569-7ab012c8dc7e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.732634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.732847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.732963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.733118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-378e4251-ff58-4c11-81e0-57e7d2509426" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.733289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.733455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.733532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.733636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.733753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.733886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.733958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.734081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5373a4c-17ac-4e15-86d8-6cc9c15a4f3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.749260] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.749407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.749487] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.749699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.749850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.751664] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.751798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.751869] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.752070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.752230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.752278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d72c0d6b-219d-45d0-992a-5e67f5d6c827" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.786221] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: IN_PROGRESS for 2s [ 845.836293] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.836747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.836998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.837329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.837595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.866669] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 845.889394] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 845.889394] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.889394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.889394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.889394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.889394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.895377] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.903047] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.903047] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53902bde-30e4-44b3-9472-853fecdeacca: rpc.has_security_group_logging(os_id): False [ 845.903047] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62c4aff5-ba77-43c8-9eb6-a56da143180b: rpc.has_security_group_logging(os_id): False [ 845.923541] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4084412-2aca-4bc0-a15c-1690668e51ea in Status: IN_PROGRESS for 2s [ 845.942151] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.942151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.942151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.942151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.944609] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.944609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.984025] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.984025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.984025] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abacf1cb-1a7e-4339-b303-5bf7331e45af with status ACTIVE [ 845.984025] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.984025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.984025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.984025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.984025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.984025] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.984025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.984025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.984025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.984025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.984025] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.984606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.984606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.984606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.984606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.984606] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abacf1cb-1a7e-4339-b303-5bf7331e45af is going to be updated. [ 845.985459] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de4976ed-85d7-4836-b6cb-a96b2293c655: rpc.has_security_group_logging(os_id): False [ 845.987601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.988143] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.988432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.988640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.989072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.990732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.990732] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53902bde-30e4-44b3-9472-853fecdeacca is going to be updated. [ 845.991113] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.991422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.992115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.993813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.993813] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fafd77cc-d50d-41af-b588-6629e9cea514: rpc.has_security_group_logging(os_id): False [ 846.020865] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.020865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.029943] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.029943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.050026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.050026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.050026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.050026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.050026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.050026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.050026] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b is going to be updated. [ 846.051752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.054851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.061891] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.061891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.061891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.061891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.061891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.061891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.095021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.095021] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.095021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.095021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.095021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.095021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.095021] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.095021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.095021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.095021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.095021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.095021] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.095021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.095021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.095631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.095631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.095631] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 is going to be updated. [ 846.097034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.099025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.153183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.153525] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.153646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.153787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.153945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.154037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.154136] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de4976ed-85d7-4836-b6cb-a96b2293c655 is going to be updated. [ 846.164339] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.164512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.164557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.165368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.165595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.171030] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.171186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.171260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.171526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.175025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.204475] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: IN_PROGRESS for 2s [ 846.206207] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b in Status: IN_PROGRESS for 2s [ 846.230361] env[69491]: INFO networking_nsxv3.common.synchronization [req-92019ae4-f251-46c6-8f61-16bf65cfaf52 req-f7fa09b2-b598-458c-925d-d6efca4d1b21 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_members [ 846.230603] env[69491]: INFO networking_nsxv3.common.synchronization [req-92019ae4-f251-46c6-8f61-16bf65cfaf52 req-f7fa09b2-b598-458c-925d-d6efca4d1b21 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 with Priority: HIGHEST for action security_group_members [ 846.230796] env[69491]: INFO networking_nsxv3.common.synchronization [req-92019ae4-f251-46c6-8f61-16bf65cfaf52 req-f7fa09b2-b598-458c-925d-d6efca4d1b21 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 846.231546] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_members [ 846.231719] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 with Priority: HIGHEST for action security_group_members [ 846.231835] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 846.232188] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.232330] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.232582] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f7c8116-1800-43a9-8bbf-52caccb697c1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.232696] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.232765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.233039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.233198] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.233297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.233360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.233524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.233621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.233822] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f7c8116-1800-43a9-8bbf-52caccb697c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.234693] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.234788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.271483] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.271720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.271835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.272177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.272413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.275594] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.275781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.275880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.276203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.276422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.297636] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 846.297972] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.298760] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.299134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.299443] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.299737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.299855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.300159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.300282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.300436] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.300597] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.322216] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: IN_PROGRESS for 2s [ 846.326503] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de4976ed-85d7-4836-b6cb-a96b2293c655 in Status: IN_PROGRESS for 2s [ 846.396860] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.409135] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.622836] env[69491]: INFO networking_nsxv3.common.synchronization [req-92019ae4-f251-46c6-8f61-16bf65cfaf52 req-f7fa09b2-b598-458c-925d-d6efca4d1b21 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 with Priority: HIGHEST for action security_group_rules [ 846.623643] env[69491]: INFO networking_nsxv3.common.synchronization [req-92019ae4-f251-46c6-8f61-16bf65cfaf52 req-f7fa09b2-b598-458c-925d-d6efca4d1b21 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 with Priority: HIGHEST for action security_group_members [ 846.623902] env[69491]: INFO networking_nsxv3.common.synchronization [req-92019ae4-f251-46c6-8f61-16bf65cfaf52 req-f7fa09b2-b598-458c-925d-d6efca4d1b21 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_rules [ 846.624072] env[69491]: INFO networking_nsxv3.common.synchronization [req-92019ae4-f251-46c6-8f61-16bf65cfaf52 req-f7fa09b2-b598-458c-925d-d6efca4d1b21 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_members [ 846.624212] env[69491]: INFO networking_nsxv3.common.synchronization [req-92019ae4-f251-46c6-8f61-16bf65cfaf52 req-f7fa09b2-b598-458c-925d-d6efca4d1b21 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_rules [ 846.624342] env[69491]: INFO networking_nsxv3.common.synchronization [req-92019ae4-f251-46c6-8f61-16bf65cfaf52 req-f7fa09b2-b598-458c-925d-d6efca4d1b21 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 846.624472] env[69491]: INFO networking_nsxv3.common.synchronization [req-92019ae4-f251-46c6-8f61-16bf65cfaf52 req-f7fa09b2-b598-458c-925d-d6efca4d1b21 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: abacf1cb-1a7e-4339-b303-5bf7331e45af with Priority: HIGHEST for action port [ 846.625236] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 with Priority: HIGHEST for action security_group_rules [ 846.625542] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_rules [ 846.625542] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 846.625680] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abacf1cb-1a7e-4339-b303-5bf7331e45af with Priority: HIGHEST for action port [ 846.625784] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_rules [ 846.625896] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 with Priority: HIGHEST for action security_group_members [ 846.625986] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_members [ 846.626343] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f7c8116-1800-43a9-8bbf-52caccb697c1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.626557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.626557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.626866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.627081] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f7c8116-1800-43a9-8bbf-52caccb697c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.629066] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.629485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.630533] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.630715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.630980] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-abacf1cb-1a7e-4339-b303-5bf7331e45af taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.631145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.631234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.631514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.631651] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abacf1cb-1a7e-4339-b303-5bf7331e45af',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.632765] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.632858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.633141] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f7c8116-1800-43a9-8bbf-52caccb697c1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.633276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.634064] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.634064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.736385] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f7c8116-1800-43a9-8bbf-52caccb697c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.803591] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.803827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.803891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.804201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.804452] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.804597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.804687] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.804861] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.804950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.805099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.805284] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.805374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.805436] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.805579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.805719] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.805819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.805878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.806017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.806095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.806209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.806304] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.901158] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.901158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.901158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.901619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.901619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.901929] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf is going to be created. [ 846.912551] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.912786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.912865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.913093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.913199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.913539] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 846.929994] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.930251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.930251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.930448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.930613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.940449] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: UNINITIALIZED for 2s [ 846.946505] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.946762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.946762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.947014] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.947140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.950129] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf in Status: SUCCESS [ 846.950218] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa2d8960-981d-4b66-be1b-51da4bb7f1cf deletion is rescheduled due to dependency. [ 846.950327] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa2d8960-981d-4b66-be1b-51da4bb7f1cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.956104] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 847.135422] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f7c8116-1800-43a9-8bbf-52caccb697c1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.135598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.135852] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abacf1cb-1a7e-4339-b303-5bf7331e45af with status ACTIVE [ 847.136111] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.136273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.136368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.136654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.137027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.137027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.137150] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.137471] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.137471] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.137608] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.137946] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.138133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.138266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.138434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.138549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.138685] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abacf1cb-1a7e-4339-b303-5bf7331e45af is going to be updated. [ 847.163509] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.163659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.163733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.163942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.164097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.164254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abacf1cb-1a7e-4339-b303-5bf7331e45af" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.238861] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f7c8116-1800-43a9-8bbf-52caccb697c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.309032] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebfca2b7-f089-437e-979a-24f210590561: rpc.has_security_group_logging(os_id): False [ 847.343616] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.343730] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.343787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.344067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.344161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.344373] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.344608] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.344608] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.344700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.344795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.345023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.345105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.345172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.345318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.345395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.345576] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.345671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.345762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.345871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.346071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.346071] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be created. [ 847.431172] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.432451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.432451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.432451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.432451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.445261] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 847.671597] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 847.671836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.672040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.672264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.672354] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.741269] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.741531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.741617] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.741885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.741991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.742106] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 is going to be created. [ 847.772889] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.773163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.773250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.773532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.773757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.785403] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 in Status: UNINITIALIZED for 2s [ 847.800926] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: SUCCESS [ 847.801209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.880412] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 847.880613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.960903] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4084412-2aca-4bc0-a15c-1690668e51ea in Status: SUCCESS [ 847.961263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.126725] env[69491]: INFO networking_nsxv3.common.synchronization [req-2cc6996f-1e41-47b7-ace0-cc74f717ff43 req-e0a87462-43dc-497d-9a5e-b09660e80a0f tempest-AttachVolumeTestJSON-1247015010 tempest-AttachVolumeTestJSON-1247015010-project-member] Enqueued Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGHEST for action security_group_members [ 848.127687] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGHEST for action security_group_members [ 848.128071] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-556224b2-1959-4315-89ac-879f1d706247 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.128208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.128275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.128615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.128809] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.128921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.128982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.129209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.129371] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.129521] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('556224b2-1959-4315-89ac-879f1d706247',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.174943] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.175204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.175288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.175583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.175840] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.175991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.176119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.176307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.176410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.176547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.176670] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.231606] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: SUCCESS [ 848.231771] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.234236] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b in Status: SUCCESS [ 848.234456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.345475] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de4976ed-85d7-4836-b6cb-a96b2293c655 in Status: SUCCESS [ 848.346192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.347447] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: SUCCESS [ 848.349529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.545971] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-304 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.546390] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-304" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.546390] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-304" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.546728] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-304" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.550134] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.550382] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.550611] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.550964] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.551184] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.551502] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.551647] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.551787] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.551945] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.552130] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.552272] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.552474] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.576177] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.576370] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 848.576552] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.576626] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-304" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.576942] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-faa74e9d-92f1-4276-a09a-4bda49fca3c5 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.577134] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-faa74e9d-92f1-4276-a09a-4bda49fca3c5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.577258] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-faa74e9d-92f1-4276-a09a-4bda49fca3c5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.577606] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-faa74e9d-92f1-4276-a09a-4bda49fca3c5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.577760] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faa74e9d-92f1-4276-a09a-4bda49fca3c5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.631805] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.631986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.632058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.632259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.632349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.632550] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.632646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.632708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.632857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.632933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.633029] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 556224b2-1959-4315-89ac-879f1d706247 already deleted. [ 848.633112] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.681771] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.681966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.681966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.682285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.682559] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.682689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.682761] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.682997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.683164] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.683282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.684100] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.684205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.684291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.684460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.684664] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.684842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.684938] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.686146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.686146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.686146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.686146] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.951886] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: SUCCESS [ 848.952149] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.952329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.952554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.952769] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.952897] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.952957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.953120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.953200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.953293] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.968308] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 848.968308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.968308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.968308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.968308] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.968308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.968308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.968308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.968308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.968308] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.082707] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.082994] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.083147] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.083437] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.083596] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.083757] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port faa74e9d-92f1-4276-a09a-4bda49fca3c5 not found, creating... [ 849.084049] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.084216] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.084414] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.084659] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.085126] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.085817] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.085996] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.086137] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.086363] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.086500] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.086650] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: faa74e9d-92f1-4276-a09a-4bda49fca3c5 is going to be created. [ 849.112166] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.112394] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.112524] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.114631] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.114631] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.114631] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-faa74e9d-92f1-4276-a09a-4bda49fca3c5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.188658] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab7773f0-7815-4a45-bf15-8a8079aa86ff: rpc.has_security_group_logging(os_id): False [ 849.213983] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.214160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.214246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.214435] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.214536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.214699] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.214801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.214865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.215024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.215101] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.215306] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.215442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.215545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.215784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.215903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.216251] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.216417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.216582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.216772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.216895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.217054] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 849.452498] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.452923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.453127] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.453511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.454014] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.456877] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.466604] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 849.466922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.470699] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.476818] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 849.744692] env[69491]: INFO networking_nsxv3.common.synchronization [req-f50653a8-0b3d-4173-a475-c207a21bd1a5 req-c3736eb6-2841-436a-b567-3a2e407cf8f2 tempest-FloatingIPsAssociationTestJSON-1311896295 tempest-FloatingIPsAssociationTestJSON-1311896295-project-member] Enqueued Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_members [ 849.745493] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGHEST for action security_group_members [ 849.745869] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.746095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.746605] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.746858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.747041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.747154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.747220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.747383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.747468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.748695] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.799747] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 in Status: SUCCESS [ 849.799985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.800536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.800770] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.800969] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.801333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.801540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.801714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.801800] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.801899] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f7c8116-1800-43a9-8bbf-52caccb697c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.961980] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.973109] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.105511] env[69491]: INFO networking_nsxv3.common.synchronization [req-2cc6996f-1e41-47b7-ace0-cc74f717ff43 req-a939683a-db86-470b-9856-7bb6280712a5 service nova] Enqueued Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGHEST for action security_group_rules [ 850.105743] env[69491]: INFO networking_nsxv3.common.synchronization [req-2cc6996f-1e41-47b7-ace0-cc74f717ff43 req-a939683a-db86-470b-9856-7bb6280712a5 service nova] Enqueued Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGHEST for action security_group_members [ 850.105904] env[69491]: INFO networking_nsxv3.common.synchronization [req-2cc6996f-1e41-47b7-ace0-cc74f717ff43 req-a939683a-db86-470b-9856-7bb6280712a5 service nova] Enqueued Resource ID: faa74e9d-92f1-4276-a09a-4bda49fca3c5 with Priority: HIGHEST for action port [ 850.106518] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGHEST for action security_group_rules [ 850.110583] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGHEST for action security_group_members [ 850.110791] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faa74e9d-92f1-4276-a09a-4bda49fca3c5 with Priority: HIGHEST for action port [ 850.111365] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-556224b2-1959-4315-89ac-879f1d706247 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.111602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.111692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.112108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.112164] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('556224b2-1959-4315-89ac-879f1d706247',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.114221] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-556224b2-1959-4315-89ac-879f1d706247 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.114339] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.114339] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.115375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.115375] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.115375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.115375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.115375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.115716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.115716] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('556224b2-1959-4315-89ac-879f1d706247',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.117540] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-faa74e9d-92f1-4276-a09a-4bda49fca3c5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.117763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faa74e9d-92f1-4276-a09a-4bda49fca3c5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.117857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faa74e9d-92f1-4276-a09a-4bda49fca3c5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.118315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faa74e9d-92f1-4276-a09a-4bda49fca3c5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.118454] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faa74e9d-92f1-4276-a09a-4bda49fca3c5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.251326] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.251565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.251627] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.251837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.276249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.276529] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.276650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.276708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.276923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.277013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.277110] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a is going to be updated. [ 850.305296] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f7c8116-1800-43a9-8bbf-52caccb697c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.313069] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.313301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.313388] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.313653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.313844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.326405] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: IN_PROGRESS for 2s [ 850.464837] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.465265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.465265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.465401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.465534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.465598] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf is going to be updated. [ 850.477391] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.477625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.477625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.477869] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.477969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.478122] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 850.501165] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.501165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.501165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.501430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.501430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.513581] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: IN_PROGRESS for 2s [ 850.517956] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.518280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.518280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.518405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.518626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.531937] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 850.622168] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('556224b2-1959-4315-89ac-879f1d706247',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.622703] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-556224b2-1959-4315-89ac-879f1d706247 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.622840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.622996] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port faa74e9d-92f1-4276-a09a-4bda49fca3c5 with status ACTIVE [ 850.623275] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.623275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.623382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.623555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.623732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.623797] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.623915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.623952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.624139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.624212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.624390] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.624479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.624547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.624741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.624804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.624866] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: faa74e9d-92f1-4276-a09a-4bda49fca3c5 is going to be updated. [ 850.648217] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.648349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.648418] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.648632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.648814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.649064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faa74e9d-92f1-4276-a09a-4bda49fca3c5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.808388] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f7c8116-1800-43a9-8bbf-52caccb697c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.950580] env[69491]: INFO networking_nsxv3.common.synchronization [req-97439531-90ac-480f-b3d2-5d15c7f4b36f req-3bdd4461-f0c7-4f53-b4f1-0d6ed686f4db tempest-ServersAdminTestJSON-362478418 tempest-ServersAdminTestJSON-362478418-project-member] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 850.951119] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 850.951561] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.951651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.951726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.952909] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.953248] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.953248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.953445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.953491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.953603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.953704] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.129248] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('556224b2-1959-4315-89ac-879f1d706247',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.315027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.315027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.315027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.315027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.315027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.315027] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 is going to be updated. [ 851.345197] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.345197] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.345197] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.345197] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.345197] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.345197] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.345997] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.346469] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.350021] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.350021] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 851.350021] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.350021] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.350021] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.350021] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 851.350021] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.350021] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.351087] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.351269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.351349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.351649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.351862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.363139] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 in Status: IN_PROGRESS for 2s [ 851.374764] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.374952] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 851.375144] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.376202] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.376202] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-e9ba7834-92e8-4621-9499-0d0f6b507fe2 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.376202] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-e9ba7834-92e8-4621-9499-0d0f6b507fe2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.376202] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-e9ba7834-92e8-4621-9499-0d0f6b507fe2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.376471] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-e9ba7834-92e8-4621-9499-0d0f6b507fe2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.376577] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9ba7834-92e8-4621-9499-0d0f6b507fe2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.456441] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.495644] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 851.495769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.631399] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.631399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.631399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.631659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.631786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.631952] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 556224b2-1959-4315-89ac-879f1d706247 is going to be created. [ 851.661205] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.661426] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.661426] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.661771] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.661890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.680277] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 556224b2-1959-4315-89ac-879f1d706247 in Status: UNINITIALIZED for 2s [ 851.884974] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.885258] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.885398] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.885708] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.885877] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.886072] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port e9ba7834-92e8-4621-9499-0d0f6b507fe2 not found, creating... [ 851.886361] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.886543] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.886677] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.886927] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.887107] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.887477] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.887657] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.887781] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.887998] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.888152] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.888298] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: e9ba7834-92e8-4621-9499-0d0f6b507fe2 is going to be created. [ 851.912188] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.912431] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.912570] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.913012] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.913568] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.913568] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-e9ba7834-92e8-4621-9499-0d0f6b507fe2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.959441] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.336421] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a in Status: SUCCESS [ 852.336818] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a deletion is rescheduled due to dependency. [ 852.336818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.461544] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.461777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.461829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.462053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.462162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.462266] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 852.500128] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.500308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.500376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.500555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.500699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.514775] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 852.529800] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: SUCCESS [ 852.530039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.530235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.530495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.530697] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.530822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.530889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.531065] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.531151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.531239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.531342] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.532355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.532542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.532757] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.532888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.532958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.533123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.533204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.533302] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.546332] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 852.546618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.547589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.547838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.548088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.548181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.548249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.548433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.548520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.548648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.548755] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.553188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.553188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.553188] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.553188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.553188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.553188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.553188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.553188] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.683596] env[69491]: INFO networking_nsxv3.common.synchronization [req-97439531-90ac-480f-b3d2-5d15c7f4b36f req-785c8339-00ac-4b76-9cd5-e42a050b9465 service nova] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_rules [ 852.683846] env[69491]: INFO networking_nsxv3.common.synchronization [req-97439531-90ac-480f-b3d2-5d15c7f4b36f req-785c8339-00ac-4b76-9cd5-e42a050b9465 service nova] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 852.683924] env[69491]: INFO networking_nsxv3.common.synchronization [req-97439531-90ac-480f-b3d2-5d15c7f4b36f req-785c8339-00ac-4b76-9cd5-e42a050b9465 service nova] Enqueued Resource ID: e9ba7834-92e8-4621-9499-0d0f6b507fe2 with Priority: HIGHEST for action port [ 852.684502] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_rules [ 852.684639] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 852.684784] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9ba7834-92e8-4621-9499-0d0f6b507fe2 with Priority: HIGHEST for action port [ 852.685017] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.686537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.691918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.691918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.691918] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.691918] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.691918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.691918] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9ba7834-92e8-4621-9499-0d0f6b507fe2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.691918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9ba7834-92e8-4621-9499-0d0f6b507fe2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.691918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9ba7834-92e8-4621-9499-0d0f6b507fe2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.692615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9ba7834-92e8-4621-9499-0d0f6b507fe2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.692615] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9ba7834-92e8-4621-9499-0d0f6b507fe2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.862129] env[69491]: INFO networking_nsxv3.common.synchronization [req-10db6dba-725f-4df5-879c-166ffa45deeb req-2d0a057d-efec-422c-9500-930e7f1ef1af tempest-ServersWithSpecificFlavorTestJSON-938071933 tempest-ServersWithSpecificFlavorTestJSON-938071933-project-member] Enqueued Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_members [ 852.862907] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_members [ 852.863316] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.863477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.863569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.863798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.864621] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.864621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.864621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.864621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.864621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.864621] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.036548] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.037923] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.054576] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.054698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.055252] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.193597] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.193748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.195117] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9ba7834-92e8-4621-9499-0d0f6b507fe2 with status ACTIVE [ 853.195342] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.195473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.195541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.195804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.195909] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.196106] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.196210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.196273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.196467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.196551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.196738] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.196834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.196898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.199218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.199218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.199218] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9ba7834-92e8-4621-9499-0d0f6b507fe2 is going to be updated. [ 853.238556] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.238709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.238776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.238997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.239391] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.239579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9ba7834-92e8-4621-9499-0d0f6b507fe2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.367023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.367335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.367335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.367472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.367561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.367759] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.367863] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.367920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.368094] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.368174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.368261] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53902bde-30e4-44b3-9472-853fecdeacca is going to be updated. [ 853.379261] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 in Status: SUCCESS [ 853.379261] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.380358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.380574] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.380776] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.380911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.380978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.381155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.381236] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.381324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.381418] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f7c8116-1800-43a9-8bbf-52caccb697c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.403310] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.403470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.403544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.403761] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.403896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.412691] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: IN_PROGRESS for 2s [ 853.539394] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96abde26-4f7d-4753-9d4c-ed85ae0b31bf: rpc.has_security_group_logging(os_id): False [ 853.540880] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.556910] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.569334] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.569334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.569334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.569334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.569722] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.569722] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.569722] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.569963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.569963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.570082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.570626] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf is going to be created. [ 853.627339] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.627339] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.627339] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.627497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.627710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.641176] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: IN_PROGRESS for 2s [ 853.697093] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 556224b2-1959-4315-89ac-879f1d706247 in Status: SUCCESS [ 853.697338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.697519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.697737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.697934] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.698464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.698464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.698464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.698464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.698464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.698809] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('556224b2-1959-4315-89ac-879f1d706247',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.884229] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f7c8116-1800-43a9-8bbf-52caccb697c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.107095] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.107307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.107367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.107560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.107638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.107751] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf is going to be updated. [ 854.110292] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.110292] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.110292] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.110292] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.110292] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.110292] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 854.137533] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.137734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.137734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.137961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.138016] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.139724] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.139836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.139887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.140069] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.140191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.150108] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: IN_PROGRESS for 2s [ 854.150779] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 854.204585] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('556224b2-1959-4315-89ac-879f1d706247',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.387712] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f7c8116-1800-43a9-8bbf-52caccb697c1: rpc.has_security_group_logging(os_id): False [ 854.406413] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.406559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.406661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.406877] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.406960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.407198] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.407295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.407355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.407495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.407563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.407655] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 is going to be created. [ 854.464221] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.464519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.464592] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.465145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.465485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.477574] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 in Status: IN_PROGRESS for 2s [ 854.528289] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 854.528528] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.528708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.528962] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.529167] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.529321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.529467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.529578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.529578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.529712] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.707531] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 556224b2-1959-4315-89ac-879f1d706247: rpc.has_security_group_logging(os_id): False [ 854.731402] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.731542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.731819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.731917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.731966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.733041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.733041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.733041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.733041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.733041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.733041] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 556224b2-1959-4315-89ac-879f1d706247 is going to be created. [ 854.806203] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.806422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.806422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.806643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.806870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.821621] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 556224b2-1959-4315-89ac-879f1d706247 in Status: IN_PROGRESS for 2s [ 855.032102] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.424542] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: SUCCESS [ 855.425338] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53902bde-30e4-44b3-9472-853fecdeacca deletion is rescheduled due to dependency. [ 855.425338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.540419] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.653034] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: SUCCESS [ 855.653279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.653458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.653681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.653764] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.985246] env[69491]: INFO networking_nsxv3.common.synchronization [req-1523454c-8322-4cef-99fc-3f76306b2273 req-e4ad4109-a5aa-4b8d-b580-620120dded03 tempest-MigrationsAdminTest-1576792364 tempest-MigrationsAdminTest-1576792364-project-member] Enqueued Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_members [ 855.985503] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_members [ 855.985651] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.985775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.985844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.987072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.987072] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.987198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.987198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.987384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.987469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.987567] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.046016] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.046186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.046260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.046459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.046545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.046645] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 856.085696] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.085696] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.085696] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.085696] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.085696] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.095667] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 856.164180] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 856.164180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.164180] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: SUCCESS [ 856.164180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.164180] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.164180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.164180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.164180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.164180] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.164180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.164180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.164180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.164180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.164180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.164180] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.165174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.165456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.165724] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.165946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.166101] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.166319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.166480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.166646] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.167680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.167932] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.168191] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.168776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.168938] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.169220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.169479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.169734] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.346293] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.346519] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.346621] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.346940] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.347224] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.347384] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.347508] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.347727] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.347878] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.349417] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.349569] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.349749] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.349833] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.349955] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.350083] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.350225] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.369031] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.369165] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 856.369310] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.369494] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-389" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.369886] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-44580602-7718-482d-8562-2261ef721bb4 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.370120] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-44580602-7718-482d-8562-2261ef721bb4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.370253] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-44580602-7718-482d-8562-2261ef721bb4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.370627] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-44580602-7718-482d-8562-2261ef721bb4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.373598] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44580602-7718-482d-8562-2261ef721bb4',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.491427] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 in Status: SUCCESS [ 856.492352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.492352] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.676531] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.676531] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.679132] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.839014] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 556224b2-1959-4315-89ac-879f1d706247 in Status: SUCCESS [ 856.843022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.874672] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.875795] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.875795] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.875795] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.875795] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.876211] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 44580602-7718-482d-8562-2261ef721bb4 not found, creating... [ 856.876661] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.876886] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.877054] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.877297] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.877427] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.877782] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.877968] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.878102] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.878317] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.878458] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.878605] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 44580602-7718-482d-8562-2261ef721bb4 is going to be created. [ 856.902625] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.902625] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.902625] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.903022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.903022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.903300] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-44580602-7718-482d-8562-2261ef721bb4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.998373] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.180150] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.184681] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96abde26-4f7d-4753-9d4c-ed85ae0b31bf: rpc.has_security_group_logging(os_id): False [ 857.185883] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.208466] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.208662] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.208765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.209097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.209235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.209465] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.209585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.209639] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.211647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.211647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.211647] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf is going to be updated. [ 857.291396] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.291396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.291396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.291396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.291396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.305121] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: IN_PROGRESS for 2s [ 857.502117] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.502117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.502117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.502117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.502117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.502117] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57178755-8937-4ec8-907c-6e349b3947d2 is going to be updated. [ 857.533743] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.533903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.533959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.534236] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.534502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.546623] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: IN_PROGRESS for 2s [ 857.685659] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.685659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.685659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.685835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.685835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.686044] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 857.687703] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.687828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.687981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.688850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.689080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.689148] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf is going to be updated. [ 857.721876] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.722143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.722242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.722550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.722798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.728233] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.728930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.728969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.729544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.729544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.740930] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: IN_PROGRESS for 2s [ 857.742032] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 857.759401] env[69491]: INFO networking_nsxv3.common.synchronization [req-1523454c-8322-4cef-99fc-3f76306b2273 req-b61e0ce4-8772-4dcc-a75d-57de53657818 service nova] Enqueued Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_rules [ 857.759703] env[69491]: INFO networking_nsxv3.common.synchronization [req-1523454c-8322-4cef-99fc-3f76306b2273 req-b61e0ce4-8772-4dcc-a75d-57de53657818 service nova] Enqueued Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_members [ 857.759775] env[69491]: INFO networking_nsxv3.common.synchronization [req-1523454c-8322-4cef-99fc-3f76306b2273 req-b61e0ce4-8772-4dcc-a75d-57de53657818 service nova] Enqueued Resource ID: 44580602-7718-482d-8562-2261ef721bb4 with Priority: HIGHEST for action port [ 857.760012] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_rules [ 857.760149] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_members [ 857.760252] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44580602-7718-482d-8562-2261ef721bb4 with Priority: HIGHEST for action port [ 857.760858] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.761976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.762098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.763203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.763304] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.765785] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.765914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.766190] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-44580602-7718-482d-8562-2261ef721bb4 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.766303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44580602-7718-482d-8562-2261ef721bb4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.766368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44580602-7718-482d-8562-2261ef721bb4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.766564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44580602-7718-482d-8562-2261ef721bb4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.766644] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44580602-7718-482d-8562-2261ef721bb4',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.106283] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 858.106522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.106719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.106979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.107199] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.107320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.107395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.107567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.107647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.107748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.107842] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.266597] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.266597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.272713] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44580602-7718-482d-8562-2261ef721bb4 with status ACTIVE [ 858.273243] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.273243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.273243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.273506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.273506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.274022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.274022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.274022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.274022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.274251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.274318] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.275325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.275325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.275325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.275325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.275325] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44580602-7718-482d-8562-2261ef721bb4 is going to be updated. [ 858.299447] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.299660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.299660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.299909] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.300070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.300238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44580602-7718-482d-8562-2261ef721bb4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.611875] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.611875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.611875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.611875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.611875] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.612565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.612565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.612565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.612565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.612565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.612739] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.612832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.612883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.613077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.613191] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.613314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.613382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.613480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.613555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.613649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.613739] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.117388] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebfca2b7-f089-437e-979a-24f210590561: rpc.has_security_group_logging(os_id): False [ 859.141463] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.141713] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.141999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.142243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.142443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.142823] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.142989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.146444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.146773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.146952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.147241] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.147432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.147432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.147624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.147624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.147829] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.147933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.147980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.148126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.148208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.148306] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 859.230961] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.231163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.231224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.231465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.231556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.247573] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 859.341091] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: SUCCESS [ 859.341336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.559670] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: SUCCESS [ 859.559670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.559670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.559670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.559670] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.559670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.559670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.559670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.559670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.559670] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.753350] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: SUCCESS [ 859.753350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.754031] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 859.754200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.754359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.754568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.754762] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.754889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.754935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.755305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.755305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.755305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.755440] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.755560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.755653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.755862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.756063] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.756162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.756221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.756532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.756532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.756532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.756661] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.063152] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.259884] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaa139e8-f09f-4a46-897a-d481019a63be: rpc.has_security_group_logging(os_id): False [ 860.282444] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.282444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.282444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.282444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.304601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.305103] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.305194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.305253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.305505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.305594] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.305794] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.305906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.305971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.306137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.306210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.306403] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.306706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.306774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.306933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.307097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.307190] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 860.371571] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.371788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.371839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.372338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.372433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.388646] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 860.566075] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.068385] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.068752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.068752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.068848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.068882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.068982] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57178755-8937-4ec8-907c-6e349b3947d2 is going to be updated. [ 861.100697] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.100876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.100953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.101244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.101395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.115611] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: IN_PROGRESS for 2s [ 861.134096] env[69491]: INFO networking_nsxv3.common.synchronization [req-6e4fce34-195f-47e2-8d31-8982636bdad0 req-42e7bdea-9e1b-47a1-a772-28760ab2a5a6 tempest-ServerRescueNegativeTestJSON-1517573171 tempest-ServerRescueNegativeTestJSON-1517573171-project-member] Enqueued Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGHEST for action security_group_members [ 861.134701] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGHEST for action security_group_members [ 861.139259] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdef2989-64ee-40c2-bd6c-f47c52643b88 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.139435] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.139521] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.139787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.140460] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.140460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.140460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.140460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.140460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.140460] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdef2989-64ee-40c2-bd6c-f47c52643b88',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.265725] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 861.265725] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.520059] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-646 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.520690] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-646" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.520690] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-646" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.520806] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-646" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.521242] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.521242] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.521387] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.522778] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.522778] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.522778] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.522778] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.522778] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.522778] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.522778] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.522778] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.522778] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.548301] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.548617] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 861.548849] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.549146] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-646" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.549627] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-e8e1b07a-77de-4036-afe9-79922022fae8 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.549903] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-e8e1b07a-77de-4036-afe9-79922022fae8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.551583] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-e8e1b07a-77de-4036-afe9-79922022fae8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.552151] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-e8e1b07a-77de-4036-afe9-79922022fae8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.552404] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8e1b07a-77de-4036-afe9-79922022fae8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.642954] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.643319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.643319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.643656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.643656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.643951] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.644020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.644069] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.644278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.644411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.644460] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 already deleted. [ 861.644545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.056707] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.056954] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.057107] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.057818] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.058010] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.058185] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port e8e1b07a-77de-4036-afe9-79922022fae8 not found, creating... [ 862.058472] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.058646] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.058771] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.059024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.066381] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.066381] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.066381] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.066381] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.066381] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.066381] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.066381] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: e8e1b07a-77de-4036-afe9-79922022fae8 is going to be created. [ 862.090034] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.090493] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.090493] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.090726] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.090966] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.091214] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-e8e1b07a-77de-4036-afe9-79922022fae8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.409451] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 862.409898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.409979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.410288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.410388] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.912936] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.913225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.913619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.913846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.914049] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.914169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.914254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.914394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.914481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.914564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.914662] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.032625] env[69491]: INFO networking_nsxv3.common.synchronization [req-6e4fce34-195f-47e2-8d31-8982636bdad0 req-6920bf84-e9b9-4962-ba23-22796d8024aa service nova] Enqueued Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGHEST for action security_group_rules [ 863.032809] env[69491]: INFO networking_nsxv3.common.synchronization [req-6e4fce34-195f-47e2-8d31-8982636bdad0 req-6920bf84-e9b9-4962-ba23-22796d8024aa service nova] Enqueued Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGHEST for action security_group_members [ 863.033127] env[69491]: INFO networking_nsxv3.common.synchronization [req-6e4fce34-195f-47e2-8d31-8982636bdad0 req-6920bf84-e9b9-4962-ba23-22796d8024aa service nova] Enqueued Resource ID: e8e1b07a-77de-4036-afe9-79922022fae8 with Priority: HIGHEST for action port [ 863.033553] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGHEST for action security_group_rules [ 863.033635] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGHEST for action security_group_members [ 863.033735] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8e1b07a-77de-4036-afe9-79922022fae8 with Priority: HIGHEST for action port [ 863.037439] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdef2989-64ee-40c2-bd6c-f47c52643b88 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.037439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.037593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.037682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.037888] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdef2989-64ee-40c2-bd6c-f47c52643b88',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.039016] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdef2989-64ee-40c2-bd6c-f47c52643b88 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.039153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.039222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.040022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.040250] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.040417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.040468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.040695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.040832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.040938] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdef2989-64ee-40c2-bd6c-f47c52643b88',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.041845] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8e1b07a-77de-4036-afe9-79922022fae8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.042091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8e1b07a-77de-4036-afe9-79922022fae8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.042222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8e1b07a-77de-4036-afe9-79922022fae8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.042404] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8e1b07a-77de-4036-afe9-79922022fae8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.042498] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8e1b07a-77de-4036-afe9-79922022fae8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.125685] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: SUCCESS [ 863.126133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.126133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.126426] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.126530] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.126708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.126708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.126862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.126975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.127084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.127183] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.417203] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.417399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.417509] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.417736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.417917] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.418032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.418098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.418502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.418502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.418502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.418992] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.418992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.418992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.418992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.419153] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.419266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.419338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.419484] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.419585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.419635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.419719] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.545469] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdef2989-64ee-40c2-bd6c-f47c52643b88',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.547338] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdef2989-64ee-40c2-bd6c-f47c52643b88 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.547338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.547697] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8e1b07a-77de-4036-afe9-79922022fae8 with status ACTIVE [ 863.548334] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.548334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.548334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.548562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.548724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.548946] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.549083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.549198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.549459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.549597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.549881] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.550058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.550453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.550453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.550567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.550663] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8e1b07a-77de-4036-afe9-79922022fae8 is going to be updated. [ 863.611159] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.611359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.611441] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.611685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.611826] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.612062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8e1b07a-77de-4036-afe9-79922022fae8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.630328] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.630518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.630604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.630844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.631063] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.631177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.631260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.631427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.631525] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.631618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.631773] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.631868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.631940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.632186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.632349] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.632446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.632500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.632638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.632732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.632821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.632914] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.922135] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaa139e8-f09f-4a46-897a-d481019a63be: rpc.has_security_group_logging(os_id): False [ 863.945537] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.947145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.947145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.947145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.947145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.947145] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.947145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.947145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.947410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.947526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.947765] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.947874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.947934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.948245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.948320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.948520] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.948616] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.948676] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.950751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.950751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.950751] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 864.039470] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.039714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.039714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.040308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.040308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.048865] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdef2989-64ee-40c2-bd6c-f47c52643b88',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.058622] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 864.135318] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57178755-8937-4ec8-907c-6e349b3947d2: rpc.has_security_group_logging(os_id): False [ 864.173594] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.176200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.176200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.176200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.206930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.206930] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.206930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.206930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.206930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.206930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.206930] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.206930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.206930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.206930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.206930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.206930] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.206930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.206930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.207606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.207606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.207606] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57178755-8937-4ec8-907c-6e349b3947d2 is going to be updated. [ 864.239729] env[69491]: INFO networking_nsxv3.common.synchronization [req-b8960ab9-a96e-4486-b03a-723435e1596f req-28ac3dae-9b45-46cc-a0c4-52e50230afb2 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGHEST for action security_group_members [ 864.240638] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGHEST for action security_group_members [ 864.241783] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.244187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.244187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.244187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.244187] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.244187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.244187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.244187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.244187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.244187] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab8f0b03-5851-4bc3-a9e8-aba2b5714126',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.298125] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.298343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.298449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.298909] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.299998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.318810] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: IN_PROGRESS for 2s [ 864.552129] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.552319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.552392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.552614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.552707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.552808] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 is going to be created. [ 864.582177] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.582394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.582463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.582740] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.582928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.594193] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 in Status: UNINITIALIZED for 2s [ 864.626021] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.626249] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.626380] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.626664] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.627029] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.627138] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.627232] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.627441] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.627615] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.627835] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.627912] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.628033] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.628151] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.628268] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.628375] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.628507] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.655114] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.655353] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 864.655501] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.655693] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.656040] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-a3666dad-a714-434b-9450-9cad674e3958 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.656230] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-a3666dad-a714-434b-9450-9cad674e3958" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.656357] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-a3666dad-a714-434b-9450-9cad674e3958" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.656707] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-a3666dad-a714-434b-9450-9cad674e3958" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.656856] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3666dad-a714-434b-9450-9cad674e3958',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.746251] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.746431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.746533] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.746778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.746862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.748058] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.748058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.748058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.748058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.748058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.748058] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 already deleted. [ 864.748058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.160729] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.161085] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.161212] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.161513] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.161676] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.161843] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port a3666dad-a714-434b-9450-9cad674e3958 not found, creating... [ 865.162154] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.162326] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.162454] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.162682] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.162826] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.163159] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.163604] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.163745] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.163972] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.164133] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.164534] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: a3666dad-a714-434b-9450-9cad674e3958 is going to be created. [ 865.185481] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.185732] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.185826] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.186249] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.186345] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.186681] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-a3666dad-a714-434b-9450-9cad674e3958" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.890924] env[69491]: INFO networking_nsxv3.common.synchronization [req-b8960ab9-a96e-4486-b03a-723435e1596f req-5feef48a-2f66-4970-96cb-bae4751150aa service nova] Enqueued Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGHEST for action security_group_rules [ 865.891144] env[69491]: INFO networking_nsxv3.common.synchronization [req-b8960ab9-a96e-4486-b03a-723435e1596f req-5feef48a-2f66-4970-96cb-bae4751150aa service nova] Enqueued Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGHEST for action security_group_members [ 865.891287] env[69491]: INFO networking_nsxv3.common.synchronization [req-b8960ab9-a96e-4486-b03a-723435e1596f req-5feef48a-2f66-4970-96cb-bae4751150aa service nova] Enqueued Resource ID: a3666dad-a714-434b-9450-9cad674e3958 with Priority: HIGHEST for action port [ 865.891514] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGHEST for action security_group_rules [ 865.891636] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGHEST for action security_group_members [ 865.891804] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3666dad-a714-434b-9450-9cad674e3958 with Priority: HIGHEST for action port [ 865.892560] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.892711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.892806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.893070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.893199] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab8f0b03-5851-4bc3-a9e8-aba2b5714126',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.894148] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.894302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.894395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.895587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.895587] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.895587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.895587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.895587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.895587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.895587] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab8f0b03-5851-4bc3-a9e8-aba2b5714126',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.896417] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3666dad-a714-434b-9450-9cad674e3958 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.896505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3666dad-a714-434b-9450-9cad674e3958" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.896598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3666dad-a714-434b-9450-9cad674e3958" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.896795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3666dad-a714-434b-9450-9cad674e3958" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.896892] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3666dad-a714-434b-9450-9cad674e3958',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.076685] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 866.076685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.334568] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: SUCCESS [ 866.335275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.401116] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.401855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.401855] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3666dad-a714-434b-9450-9cad674e3958 with status ACTIVE [ 866.401855] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.401855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.402144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.402198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.402265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.402441] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.402602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.402602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.402785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.402860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.403054] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.403144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.403206] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.403345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.403416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.403499] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3666dad-a714-434b-9450-9cad674e3958 is going to be updated. [ 866.405127] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab8f0b03-5851-4bc3-a9e8-aba2b5714126',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.428415] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.428415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.428415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.428415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.428602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.428745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3666dad-a714-434b-9450-9cad674e3958" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.612029] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 in Status: SUCCESS [ 866.612029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.612329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.612924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.612924] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.613310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.613310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.613310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.613470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.613470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.613684] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdef2989-64ee-40c2-bd6c-f47c52643b88',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.907447] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab8f0b03-5851-4bc3-a9e8-aba2b5714126',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.119229] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdef2989-64ee-40c2-bd6c-f47c52643b88',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.409880] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.410253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.410253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.410368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.410492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.411566] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 is going to be created. [ 867.439950] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.440126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.444021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.444021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.444021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.453314] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 in Status: UNINITIALIZED for 2s [ 867.620943] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdef2989-64ee-40c2-bd6c-f47c52643b88: rpc.has_security_group_logging(os_id): False [ 867.647484] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.647879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.647879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.648054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.648054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.648447] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.648447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.648564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.648828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.648828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.648828] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 is going to be created. [ 867.733144] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.733308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.733458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.733704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.733910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.751801] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 in Status: IN_PROGRESS for 2s [ 869.313438] env[69491]: INFO networking_nsxv3.common.synchronization [req-43cd2288-cfa7-4dda-a461-572ec2bdceef req-d35f6b6a-8ef9-4205-85e6-3746c3c42966 tempest-ServersTestMultiNic-1676642349 tempest-ServersTestMultiNic-1676642349-project-member] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 869.315200] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 869.316034] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.316034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.316034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.316034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.316335] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.316825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.316931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.317316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.317316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.317547] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.466302] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 in Status: SUCCESS [ 869.466609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.467208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.471473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.471473] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.471473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.471473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.471473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.471473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.471473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.471473] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab8f0b03-5851-4bc3-a9e8-aba2b5714126',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.717992] env[69491]: INFO networking_nsxv3.common.synchronization [req-43cd2288-cfa7-4dda-a461-572ec2bdceef req-5fdc76de-b6ec-421d-8d9c-42dbcfd5bc4a tempest-ServersTestMultiNic-1676642349 tempest-ServersTestMultiNic-1676642349-project-member] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 869.718703] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 869.722158] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.722401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.770145] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 in Status: SUCCESS [ 869.770452] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.820225] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.820415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.820531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.820778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.820874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.821104] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.821264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.821367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.821568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.821651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.821744] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be deleted. [ 869.867253] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.867655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.867771] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.868064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.868219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.868276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.868474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.868678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.868900] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.869041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.869120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.869752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.869752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.869994] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.971240] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab8f0b03-5851-4bc3-a9e8-aba2b5714126',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.058301] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.060212] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-463" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.060212] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-463" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.060212] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-463" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.060212] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.060212] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.060212] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.060648] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.060833] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.061075] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.061208] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.061328] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.061444] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.061565] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.061679] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.061830] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.084825] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.085370] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 870.085370] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.085370] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-463" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.085703] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-acf3bb5c-6440-40b6-846a-9c99f20abdac taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.085929] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-acf3bb5c-6440-40b6-846a-9c99f20abdac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.086083] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-acf3bb5c-6440-40b6-846a-9c99f20abdac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.086462] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-acf3bb5c-6440-40b6-846a-9c99f20abdac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.086661] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acf3bb5c-6440-40b6-846a-9c99f20abdac',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.373584] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.373915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.373915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.374181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.374273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.374582] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.374697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.374765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.374924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.375007] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.375104] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 already deleted. [ 870.375185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.473815] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab8f0b03-5851-4bc3-a9e8-aba2b5714126: rpc.has_security_group_logging(os_id): False [ 870.506854] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.507099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.507099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.507380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.507554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.508075] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.508075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.508075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.508301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.508301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.508393] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 is going to be created. [ 870.588418] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.588711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.588786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.589081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.589343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.591929] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.592280] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.592444] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.592775] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.592995] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.593230] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port acf3bb5c-6440-40b6-846a-9c99f20abdac not found, creating... [ 870.593589] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.595209] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.595350] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.595621] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.595982] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.596326] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.596503] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.596628] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.596857] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.597044] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.597183] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: acf3bb5c-6440-40b6-846a-9c99f20abdac is going to be created. [ 870.613038] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 in Status: IN_PROGRESS for 2s [ 870.632507] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.632825] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.633032] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.633380] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.633690] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.633983] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-acf3bb5c-6440-40b6-846a-9c99f20abdac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.354907] env[69491]: INFO networking_nsxv3.common.synchronization [req-43cd2288-cfa7-4dda-a461-572ec2bdceef req-1da3e6b9-ff6a-4749-ba4c-a6796dccec56 service nova] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_rules [ 871.354907] env[69491]: INFO networking_nsxv3.common.synchronization [req-43cd2288-cfa7-4dda-a461-572ec2bdceef req-1da3e6b9-ff6a-4749-ba4c-a6796dccec56 service nova] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 871.354907] env[69491]: INFO networking_nsxv3.common.synchronization [req-43cd2288-cfa7-4dda-a461-572ec2bdceef req-1da3e6b9-ff6a-4749-ba4c-a6796dccec56 service nova] Enqueued Resource ID: acf3bb5c-6440-40b6-846a-9c99f20abdac with Priority: HIGHEST for action port [ 871.354907] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_rules [ 871.354907] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 871.354907] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf3bb5c-6440-40b6-846a-9c99f20abdac with Priority: HIGHEST for action port [ 871.354907] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.354907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.354907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.354907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.354907] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.355647] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.355647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.355647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.355867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.355915] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.356135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.356135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.356305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.356389] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.356477] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.357239] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-acf3bb5c-6440-40b6-846a-9c99f20abdac taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.357394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acf3bb5c-6440-40b6-846a-9c99f20abdac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.357555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acf3bb5c-6440-40b6-846a-9c99f20abdac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.358125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acf3bb5c-6440-40b6-846a-9c99f20abdac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.358125] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acf3bb5c-6440-40b6-846a-9c99f20abdac',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.417191] env[69491]: INFO networking_nsxv3.common.synchronization [None req-c9a5633a-8da3-4fe6-9220-09730b258b34 None None] Enqueued Resource ID: 224070fa-d71b-47c8-b3c2-05e267bbaba9 with Priority: HIGHEST for action port [ 871.418111] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 224070fa-d71b-47c8-b3c2-05e267bbaba9 with Priority: HIGHEST for action port [ 871.418355] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-224070fa-d71b-47c8-b3c2-05e267bbaba9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.418502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-224070fa-d71b-47c8-b3c2-05e267bbaba9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.418502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-224070fa-d71b-47c8-b3c2-05e267bbaba9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.418865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-224070fa-d71b-47c8-b3c2-05e267bbaba9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.418865] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('224070fa-d71b-47c8-b3c2-05e267bbaba9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.863203] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.864066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.864066] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.864520] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acf3bb5c-6440-40b6-846a-9c99f20abdac with status ACTIVE [ 871.864720] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.864836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.864899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.865769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.865769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.865769] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.865769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.865769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.865769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.865769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.866297] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.866359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.866486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.866667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.866768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.867139] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acf3bb5c-6440-40b6-846a-9c99f20abdac is going to be updated. [ 871.889826] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.891050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.891274] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.892506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.892506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.892506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acf3bb5c-6440-40b6-846a-9c99f20abdac" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.921082] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 224070fa-d71b-47c8-b3c2-05e267bbaba9 [ 871.921407] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.921507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.921616] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.921892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.921974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.922100] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:224070fa-d71b-47c8-b3c2-05e267bbaba9 already deleted. [ 871.922205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-224070fa-d71b-47c8-b3c2-05e267bbaba9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.334135] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-905 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.334611] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-905" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.334611] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-905" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.335020] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-905" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.335432] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.335564] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.335713] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.335998] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.336201] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.336480] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.336891] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.336891] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.337047] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.337215] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.337504] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.337752] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.357710] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.357894] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 872.358069] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.358258] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-905" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.358587] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-f5e140a4-a75a-40d5-b91f-82699068e5ee taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.358936] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-f5e140a4-a75a-40d5-b91f-82699068e5ee" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.358936] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-f5e140a4-a75a-40d5-b91f-82699068e5ee" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.359264] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-f5e140a4-a75a-40d5-b91f-82699068e5ee" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.359432] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5e140a4-a75a-40d5-b91f-82699068e5ee',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.369466] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.627988] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 in Status: SUCCESS [ 872.629047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.862073] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.862412] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.862534] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.862774] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.862929] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.863105] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port f5e140a4-a75a-40d5-b91f-82699068e5ee not found, creating... [ 872.863381] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.863548] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.863670] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.863903] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.864062] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.864369] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.864532] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.864655] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.864874] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.865045] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.865197] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: f5e140a4-a75a-40d5-b91f-82699068e5ee is going to be created. [ 872.872173] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.872449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.872449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.872613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.872702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.872805] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be created. [ 872.923657] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.924212] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.924212] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.924387] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.924586] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.924896] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-f5e140a4-a75a-40d5-b91f-82699068e5ee" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.935902] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.936104] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.936171] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.936367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.936590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.948369] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: UNINITIALIZED for 2s [ 873.860649] env[69491]: INFO networking_nsxv3.common.synchronization [req-43cd2288-cfa7-4dda-a461-572ec2bdceef req-a9a60547-4701-4001-8b8d-f0c5c58ebdad service nova] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_rules [ 873.861009] env[69491]: INFO networking_nsxv3.common.synchronization [req-43cd2288-cfa7-4dda-a461-572ec2bdceef req-a9a60547-4701-4001-8b8d-f0c5c58ebdad service nova] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 873.861072] env[69491]: INFO networking_nsxv3.common.synchronization [req-43cd2288-cfa7-4dda-a461-572ec2bdceef req-a9a60547-4701-4001-8b8d-f0c5c58ebdad service nova] Enqueued Resource ID: f5e140a4-a75a-40d5-b91f-82699068e5ee with Priority: HIGHEST for action port [ 873.861952] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_rules [ 873.863011] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 873.863011] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e140a4-a75a-40d5-b91f-82699068e5ee with Priority: HIGHEST for action port [ 873.863011] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.863011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.863377] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.863377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.863478] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5e140a4-a75a-40d5-b91f-82699068e5ee taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.863565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5e140a4-a75a-40d5-b91f-82699068e5ee" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.863627] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5e140a4-a75a-40d5-b91f-82699068e5ee" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.863866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5e140a4-a75a-40d5-b91f-82699068e5ee" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.863919] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5e140a4-a75a-40d5-b91f-82699068e5ee',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.366096] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5e140a4-a75a-40d5-b91f-82699068e5ee with status ACTIVE [ 874.366354] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.366500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.366573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.366798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.366903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.367101] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.367201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.367263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.367416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.367495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.367678] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.367772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.367835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.368606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.368606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.368606] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5e140a4-a75a-40d5-b91f-82699068e5ee is going to be updated. [ 874.393534] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.393741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.393789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.394016] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.394142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.394512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5e140a4-a75a-40d5-b91f-82699068e5ee" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.553374] env[69491]: INFO networking_nsxv3.common.synchronization [None req-0d365f60-2fc3-4c03-9617-2c7abd95e96b None None] Enqueued Resource ID: 5814412b-599e-4950-8ba3-1cec040e6d1d with Priority: HIGHEST for action port [ 874.554022] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5814412b-599e-4950-8ba3-1cec040e6d1d with Priority: HIGHEST for action port [ 874.554860] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-5814412b-599e-4950-8ba3-1cec040e6d1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.554860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5814412b-599e-4950-8ba3-1cec040e6d1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.554860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5814412b-599e-4950-8ba3-1cec040e6d1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.554860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5814412b-599e-4950-8ba3-1cec040e6d1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.554860] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5814412b-599e-4950-8ba3-1cec040e6d1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.959313] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 874.960147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.960147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.960147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.960353] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.960353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.960512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.960585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.960727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.960809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.960860] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.961869] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.961979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.962569] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.962712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.962712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.962908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.962908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.962986] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.060595] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5814412b-599e-4950-8ba3-1cec040e6d1d [ 875.060867] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.061178] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.061178] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.061382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.061486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.061590] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5814412b-599e-4950-8ba3-1cec040e6d1d already deleted. [ 875.061772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5814412b-599e-4950-8ba3-1cec040e6d1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.080719] env[69491]: INFO networking_nsxv3.common.synchronization [req-596b8e3a-cf20-4179-aa74-21a2e4cf1e10 req-6c71514a-7cf8-4ef1-a9d8-6710fab6a7f6 tempest-ServersNegativeTestJSON-337259715 tempest-ServersNegativeTestJSON-337259715-project-member] Enqueued Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 875.081355] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 875.081682] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.081808] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.081878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.084226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.085291] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.085427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.085499] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.085713] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.086667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.086821] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.465762] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.466019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.466196] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.590609] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.971802] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.093692] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.193309] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-922 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.193491] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-922" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.193551] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-922" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.194356] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-922" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.194356] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.194670] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.194955] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.195213] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.195367] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.195859] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.197191] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.197191] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.197191] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.197191] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.197191] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.197191] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.218600] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.218600] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 876.218977] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.218977] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-922" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.219254] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-7547191f-a7c3-4899-bf72-13671bdf32a8 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.219368] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-7547191f-a7c3-4899-bf72-13671bdf32a8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.219506] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-7547191f-a7c3-4899-bf72-13671bdf32a8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.219924] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-7547191f-a7c3-4899-bf72-13671bdf32a8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.220098] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7547191f-a7c3-4899-bf72-13671bdf32a8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.474958] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.475901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.475901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.475901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.475901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.475901] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be updated. [ 876.521875] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.522265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.522265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.522475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.522634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.537202] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 876.595978] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.596222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.596222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.596459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.596715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.596715] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 is going to be updated. [ 876.644576] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.644734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.644850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.645099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.645260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.660702] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: IN_PROGRESS for 2s [ 876.725412] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.725412] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.725412] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.725412] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.725412] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.725412] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 7547191f-a7c3-4899-bf72-13671bdf32a8 not found, creating... [ 876.725412] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.725412] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.725412] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.725412] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.725892] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.725892] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.726975] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.726975] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.726975] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.727341] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.727341] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 7547191f-a7c3-4899-bf72-13671bdf32a8 is going to be created. [ 876.757031] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.757031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.757031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.757031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.757031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.757031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-7547191f-a7c3-4899-bf72-13671bdf32a8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.670940] env[69491]: INFO networking_nsxv3.common.synchronization [req-596b8e3a-cf20-4179-aa74-21a2e4cf1e10 req-e66f9750-0075-4ce9-aa01-976b9bbaa8f4 service nova] Enqueued Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_rules [ 877.671207] env[69491]: INFO networking_nsxv3.common.synchronization [req-596b8e3a-cf20-4179-aa74-21a2e4cf1e10 req-e66f9750-0075-4ce9-aa01-976b9bbaa8f4 service nova] Enqueued Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 877.671291] env[69491]: INFO networking_nsxv3.common.synchronization [req-596b8e3a-cf20-4179-aa74-21a2e4cf1e10 req-e66f9750-0075-4ce9-aa01-976b9bbaa8f4 service nova] Enqueued Resource ID: 7547191f-a7c3-4899-bf72-13671bdf32a8 with Priority: HIGHEST for action port [ 877.671528] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_rules [ 877.671869] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 877.671869] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7547191f-a7c3-4899-bf72-13671bdf32a8 with Priority: HIGHEST for action port [ 877.673040] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.673186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.673268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.673465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.673576] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.674827] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.674965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.675344] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-7547191f-a7c3-4899-bf72-13671bdf32a8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.675344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7547191f-a7c3-4899-bf72-13671bdf32a8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.675344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7547191f-a7c3-4899-bf72-13671bdf32a8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.675573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7547191f-a7c3-4899-bf72-13671bdf32a8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.675610] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7547191f-a7c3-4899-bf72-13671bdf32a8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.178566] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7547191f-a7c3-4899-bf72-13671bdf32a8 with status ACTIVE [ 878.178810] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.178955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.179079] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.179255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.179338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.179919] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.179919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.179919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.179919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.179919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.180154] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.180206] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.180297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.180485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.180572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.180652] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7547191f-a7c3-4899-bf72-13671bdf32a8 is going to be updated. [ 878.181895] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.182013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.203160] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.203160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.203160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.203160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.203160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.203160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7547191f-a7c3-4899-bf72-13671bdf32a8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.548770] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 878.548964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.549179] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.550035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.550035] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.550035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.550035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.550035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.550337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.550337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.550337] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.550452] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.550488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.550658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.550803] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.550898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.550961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.551117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.551210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.551380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.551488] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.671866] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: SUCCESS [ 878.671866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.671866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.671866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.671866] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.672353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.672353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.672353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.672353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.672353] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.055161] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 415ca665-bf4f-490e-98cb-4ba509031109: rpc.has_security_group_logging(os_id): False [ 879.077798] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.078064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.078130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.078331] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.078422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.078630] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.078733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.078831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.078945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.079031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.079238] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.079353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.079409] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.079531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.079704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.079799] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.079960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.079960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.080198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.080347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.080347] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be created. [ 879.169413] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.169575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.169645] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.169863] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.170090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.174938] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.184196] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 879.678240] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.182314] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.182314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.182314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.182314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.182314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.182314] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 is going to be updated. [ 880.217422] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.217567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.217643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.217927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.218136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.231387] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: IN_PROGRESS for 2s [ 881.216041] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 881.216041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.216041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.216041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.216648] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.440936] env[69491]: INFO networking_nsxv3.common.synchronization [None req-f4d53457-7129-4617-a5c3-774f657d636b None None] Enqueued Resource ID: da1439ff-d74e-457a-bcab-63ad659891ef with Priority: HIGHEST for action port [ 881.441451] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da1439ff-d74e-457a-bcab-63ad659891ef with Priority: HIGHEST for action port [ 881.441852] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-da1439ff-d74e-457a-bcab-63ad659891ef taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.442058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da1439ff-d74e-457a-bcab-63ad659891ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.442158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da1439ff-d74e-457a-bcab-63ad659891ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.442987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da1439ff-d74e-457a-bcab-63ad659891ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.442987] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da1439ff-d74e-457a-bcab-63ad659891ef',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.502034] env[69491]: INFO networking_nsxv3.common.synchronization [req-36cefb26-1a02-4092-bedd-d273524d36f8 req-baf732ca-865a-463e-9260-a9fe95eb78b5 tempest-ListImageFiltersTestJSON-361025592 tempest-ListImageFiltersTestJSON-361025592-project-member] Enqueued Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_members [ 881.502034] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_members [ 881.502034] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.502034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.502034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.502034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.502034] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.502034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.502034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.502034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.502034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.502034] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.722390] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.722610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.722757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.722988] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.723186] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.723288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.723353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.723503] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.723589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.723745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.723838] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.945420] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da1439ff-d74e-457a-bcab-63ad659891ef [ 881.945667] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.945896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.946073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.946372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.946487] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.946600] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da1439ff-d74e-457a-bcab-63ad659891ef already deleted. [ 881.946677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da1439ff-d74e-457a-bcab-63ad659891ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.004640] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.232056] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.232056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.232056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.232056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.232056] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.232056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.232056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.232056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.232056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.232056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.232056] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.232056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.232056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.232056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.232056] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.232056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.232952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.232952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.232952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.232952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.232952] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.245840] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: SUCCESS [ 882.245840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.245840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.245840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.245840] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.245840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.245840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.245840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.245840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.245840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.245840] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.507182] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.620891] env[69491]: INFO networking_nsxv3.common.synchronization [req-8990fd56-d130-4299-9197-9fb0aef997df req-38cf2eca-05f8-4cb9-b6f9-bbc83e87c31e tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 882.620891] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 882.622519] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.622754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.622880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.623182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.624085] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.624279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.624394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.625328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.626324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.626324] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.735749] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 415ca665-bf4f-490e-98cb-4ba509031109: rpc.has_security_group_logging(os_id): False [ 882.748742] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.748953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.749018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.749216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.749390] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.749495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.749589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.749705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.749812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.749879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.750039] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.750134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.750195] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.750341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.750482] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.750579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.750652] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.750759] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.750839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.750918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.751029] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.759910] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.760070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.760141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.760360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.760449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.760798] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.760905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.760982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.761145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.761217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.761430] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.761525] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.761589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.761731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.761794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.761974] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.762076] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.762245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.762295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.762341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.762431] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be updated. [ 882.836458] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.836458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.836458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.836458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.836458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.856817] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 882.996981] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.997269] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-376" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.997382] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-376" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.997709] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-376" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.998028] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.998209] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.998305] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.998519] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.998742] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.998884] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.999070] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.999253] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.999373] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.999487] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.999592] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.000471] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.010996] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.011268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.011268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.011380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.011461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.011570] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06871947-bfe0-4792-9f13-39942cbccdf7 is going to be updated. [ 883.027616] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.027803] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 883.027978] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.030943] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-376" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.030943] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-b7ad82ba-7c7d-4858-968b-038a324ce7ef taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.030943] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.030943] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.030943] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.030943] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7ad82ba-7c7d-4858-968b-038a324ce7ef',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.049862] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.050124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.050124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.050340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.050489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.062975] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: IN_PROGRESS for 2s [ 883.128400] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.128588] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.128647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.128861] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.128953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.129179] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.129278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.129352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.129491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.129561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.129648] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 already deleted. [ 883.129728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.252973] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fafd77cc-d50d-41af-b588-6629e9cea514: rpc.has_security_group_logging(os_id): False [ 883.270336] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.270473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.270575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.270844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.270909] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.271120] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.271226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.271291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.271775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.271775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.271775] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.271948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.271948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.272084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.272159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.272344] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.272578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.272578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.272625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.272735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.272840] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 is going to be updated. [ 883.333784] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.333784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.333784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.333979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.334101] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.350041] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: IN_PROGRESS for 2s [ 883.532063] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.532351] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.532527] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.532828] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.533038] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.533253] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port b7ad82ba-7c7d-4858-968b-038a324ce7ef not found, creating... [ 883.533661] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.533901] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.534015] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.534334] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.534444] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.534726] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.534956] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.535114] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.535369] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.535497] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.535682] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: b7ad82ba-7c7d-4858-968b-038a324ce7ef is going to be created. [ 883.557033] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.557223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.557223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.557518] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.557755] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.557979] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.154860] env[69491]: INFO networking_nsxv3.common.synchronization [None req-4929f741-f4f1-46ec-81dc-a6013728f63a None None] Enqueued Resource ID: 62bc3346-a2f8-4748-a771-9d8d14ce5df8 with Priority: HIGHEST for action port [ 884.155141] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62bc3346-a2f8-4748-a771-9d8d14ce5df8 with Priority: HIGHEST for action port [ 884.155928] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-62bc3346-a2f8-4748-a771-9d8d14ce5df8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.155928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62bc3346-a2f8-4748-a771-9d8d14ce5df8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.155928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62bc3346-a2f8-4748-a771-9d8d14ce5df8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.157609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62bc3346-a2f8-4748-a771-9d8d14ce5df8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.157706] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62bc3346-a2f8-4748-a771-9d8d14ce5df8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.261520] env[69491]: INFO networking_nsxv3.common.synchronization [req-8990fd56-d130-4299-9197-9fb0aef997df req-8b3ae7b4-a501-45f4-bf66-1eee8a86129d service nova] Enqueued Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_rules [ 884.261520] env[69491]: INFO networking_nsxv3.common.synchronization [req-8990fd56-d130-4299-9197-9fb0aef997df req-8b3ae7b4-a501-45f4-bf66-1eee8a86129d service nova] Enqueued Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 884.261520] env[69491]: INFO networking_nsxv3.common.synchronization [req-8990fd56-d130-4299-9197-9fb0aef997df req-8b3ae7b4-a501-45f4-bf66-1eee8a86129d service nova] Enqueued Resource ID: b7ad82ba-7c7d-4858-968b-038a324ce7ef with Priority: HIGHEST for action port [ 884.261520] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_rules [ 884.261520] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 884.261520] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7ad82ba-7c7d-4858-968b-038a324ce7ef with Priority: HIGHEST for action port [ 884.262304] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.262555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.262555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.263060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.263060] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.264127] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.264591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.264984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.265221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.265428] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.265572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.265667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.265862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.265989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.266329] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.267024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7ad82ba-7c7d-4858-968b-038a324ce7ef taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.267145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.267249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.267436] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.267552] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7ad82ba-7c7d-4858-968b-038a324ce7ef',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.660787] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62bc3346-a2f8-4748-a771-9d8d14ce5df8 [ 884.661245] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.661245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.661438] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.661468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.661555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.661661] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62bc3346-a2f8-4748-a771-9d8d14ce5df8 already deleted. [ 884.661724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62bc3346-a2f8-4748-a771-9d8d14ce5df8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.769490] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.770667] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.770813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.770997] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7ad82ba-7c7d-4858-968b-038a324ce7ef with status ACTIVE [ 884.771178] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.771310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.771395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.771614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.771714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.771904] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.772026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.772096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.772310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.772399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.772608] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.772726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.772821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.772980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.773224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.773332] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7ad82ba-7c7d-4858-968b-038a324ce7ef is going to be updated. [ 884.811379] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.811379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.811379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.811379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.811379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.811379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.876516] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 884.876951] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.074253] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: SUCCESS [ 885.074420] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.275528] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.371044] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: SUCCESS [ 885.371907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.452832] env[69491]: INFO networking_nsxv3.common.synchronization [req-45f42725-7f3b-40e1-8530-29dbcc941b2c req-5d4ce45f-f56e-469f-b67e-47cc5168aeee tempest-InstanceActionsTestJSON-1668801794 tempest-InstanceActionsTestJSON-1668801794-project-member] Enqueued Resource ID: 1174b667-c607-4471-b059-900f8b5c4de2 with Priority: HIGHEST for action security_group_members [ 885.453110] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1174b667-c607-4471-b059-900f8b5c4de2 with Priority: HIGHEST for action security_group_members [ 885.453371] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-1174b667-c607-4471-b059-900f8b5c4de2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.453494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.453559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.453813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.453983] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.455409] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.455514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.455698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.455784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.455879] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1174b667-c607-4471-b059-900f8b5c4de2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.778225] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.778375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.778457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.778679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.778769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.778983] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 is going to be created. [ 885.814984] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.814984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.814984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.814984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.814984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.817793] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.818279] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-578" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.818581] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-578" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.819060] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-578" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.819881] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.820213] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.820522] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.820900] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.821187] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.821667] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.821989] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.822370] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.822576] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.822836] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.824017] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.824017] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.825571] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: UNINITIALIZED for 2s [ 885.845796] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.845796] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.845796] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.845796] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-578" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.845796] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-940f7c23-6190-42fa-ace9-1f0fc9a3ae29 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.845796] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-940f7c23-6190-42fa-ace9-1f0fc9a3ae29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.845796] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-940f7c23-6190-42fa-ace9-1f0fc9a3ae29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.845796] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-940f7c23-6190-42fa-ace9-1f0fc9a3ae29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.845796] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('940f7c23-6190-42fa-ace9-1f0fc9a3ae29',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.961584] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.961756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.961828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.962070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.962155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.962357] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.962450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.962504] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.962654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.962745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.962887] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1174b667-c607-4471-b059-900f8b5c4de2 already deleted. [ 885.963031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.348265] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.348664] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.348664] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.348939] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.349151] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.349419] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 940f7c23-6190-42fa-ace9-1f0fc9a3ae29 not found, creating... [ 886.349686] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.349908] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.350082] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.350358] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.350536] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.350942] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.351135] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.351514] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.351514] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.351692] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.351875] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 940f7c23-6190-42fa-ace9-1f0fc9a3ae29 is going to be created. [ 886.378921] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.379330] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.379970] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.379970] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.380331] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.380669] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-940f7c23-6190-42fa-ace9-1f0fc9a3ae29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.136393] env[69491]: INFO networking_nsxv3.common.synchronization [req-45f42725-7f3b-40e1-8530-29dbcc941b2c req-a52bd769-eb9b-4860-8a47-85d44a5614f7 service nova] Enqueued Resource ID: 1174b667-c607-4471-b059-900f8b5c4de2 with Priority: HIGHEST for action security_group_rules [ 887.136393] env[69491]: INFO networking_nsxv3.common.synchronization [req-45f42725-7f3b-40e1-8530-29dbcc941b2c req-a52bd769-eb9b-4860-8a47-85d44a5614f7 service nova] Enqueued Resource ID: 1174b667-c607-4471-b059-900f8b5c4de2 with Priority: HIGHEST for action security_group_members [ 887.136393] env[69491]: INFO networking_nsxv3.common.synchronization [req-45f42725-7f3b-40e1-8530-29dbcc941b2c req-a52bd769-eb9b-4860-8a47-85d44a5614f7 service nova] Enqueued Resource ID: 940f7c23-6190-42fa-ace9-1f0fc9a3ae29 with Priority: HIGHEST for action port [ 887.136393] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1174b667-c607-4471-b059-900f8b5c4de2 with Priority: HIGHEST for action security_group_rules [ 887.136393] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1174b667-c607-4471-b059-900f8b5c4de2 with Priority: HIGHEST for action security_group_members [ 887.136678] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 940f7c23-6190-42fa-ace9-1f0fc9a3ae29 with Priority: HIGHEST for action port [ 887.137103] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1174b667-c607-4471-b059-900f8b5c4de2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.137475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.137666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.138042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.139235] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1174b667-c607-4471-b059-900f8b5c4de2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.140109] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-1174b667-c607-4471-b059-900f8b5c4de2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.140376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.140552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.140892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.141663] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.141873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.142054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.143022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.143022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.143022] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1174b667-c607-4471-b059-900f8b5c4de2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.144076] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-940f7c23-6190-42fa-ace9-1f0fc9a3ae29 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.144569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-940f7c23-6190-42fa-ace9-1f0fc9a3ae29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.144786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-940f7c23-6190-42fa-ace9-1f0fc9a3ae29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.145087] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-940f7c23-6190-42fa-ace9-1f0fc9a3ae29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.145270] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('940f7c23-6190-42fa-ace9-1f0fc9a3ae29',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.413117] env[69491]: INFO networking_nsxv3.common.synchronization [req-8ff5840b-193a-4fe3-81da-396a05c76d6e req-57c6b082-25bd-40a3-b519-3e8fdf21c469 tempest-ServersTestMultiNic-1676642349 tempest-ServersTestMultiNic-1676642349-project-member] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 887.413117] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 887.413117] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.413927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.416320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.416320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.416320] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.416320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.416320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.416320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.416320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.416320] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.640711] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-1174b667-c607-4471-b059-900f8b5c4de2 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.640711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.645998] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1174b667-c607-4471-b059-900f8b5c4de2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.648026] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 940f7c23-6190-42fa-ace9-1f0fc9a3ae29 with status ACTIVE [ 887.651098] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.651098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.651098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.651098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.651098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.651098] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.651098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.651098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.651098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.651098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.651098] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.651098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.651098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.651098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.651098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.651098] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 940f7c23-6190-42fa-ace9-1f0fc9a3ae29 is going to be updated. [ 887.674434] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.674434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.674434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.674434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.674434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.674434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-940f7c23-6190-42fa-ace9-1f0fc9a3ae29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.791570] env[69491]: INFO networking_nsxv3.common.synchronization [req-8ff5840b-193a-4fe3-81da-396a05c76d6e req-cd88c6c9-ceee-48c6-a6d1-b918d0865bbd tempest-ServersTestMultiNic-1676642349 tempest-ServersTestMultiNic-1676642349-project-member] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 887.792220] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGHEST for action security_group_members [ 887.792604] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.792739] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.836129] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: SUCCESS [ 887.836405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.836597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.836830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.837034] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.837191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.837220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.837379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.837502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.837620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.837728] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.917855] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.148580] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1174b667-c607-4471-b059-900f8b5c4de2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.341144] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.341317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.341421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.341731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.341984] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.342146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.342256] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.344416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.344416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.344416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.344416] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.344416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.344416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.344416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.344773] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.344773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.344773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.344877] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.345189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.345189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.345189] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.420298] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.533447] env[69491]: INFO networking_nsxv3.common.synchronization [req-36ba6e33-7a15-4a59-9cea-47bde7ee7b46 req-4447a2a3-6ed9-4186-b64f-90dc7571dfaa tempest-ServerActionsTestOtherB-761111206 tempest-ServerActionsTestOtherB-761111206-project-member] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 888.534675] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 888.537081] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.537081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.537081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.537081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.537081] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.537081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.537081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.537081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.537081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.537081] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.652946] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.652946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.652946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.652946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.652946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.652946] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1174b667-c607-4471-b059-900f8b5c4de2 is going to be created. [ 888.680051] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.680051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.680051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.680051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.680051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.693146] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1174b667-c607-4471-b059-900f8b5c4de2 in Status: UNINITIALIZED for 2s [ 888.847045] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d564cdb5-54f1-4da6-8031-9d2e67dd8a08: rpc.has_security_group_logging(os_id): False [ 888.865707] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.866784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.867063] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.867207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.867882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.867882] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.867882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.867882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.867882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.868102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.868168] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.868284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.868373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.868552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.868649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.868875] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.869010] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.869100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.869338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.869460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.869588] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 is going to be created. [ 888.925063] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.925243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.925308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.926678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.926678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.926678] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be updated. [ 888.944194] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.944399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.944437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.944724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.944891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.962200] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: IN_PROGRESS for 2s [ 888.971213] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.974333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.974333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.974333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.974333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.982227] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 889.045028] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.045028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.045028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.045028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.045028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.045028] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.045028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.045028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.045028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.045028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.045028] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 889.089022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.089022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.089022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.089022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.089022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.101740] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 890.706456] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1174b667-c607-4471-b059-900f8b5c4de2 in Status: SUCCESS [ 890.706456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.706456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.706456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.706456] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.706456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.706456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.706456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.706456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.706456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.706456] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1174b667-c607-4471-b059-900f8b5c4de2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.944155] env[69491]: INFO networking_nsxv3.common.synchronization [req-88077025-e84e-4115-9717-c364cbfbac96 req-3ee48c3e-ed10-4e08-93a8-d9613d628c07 tempest-ImagesTestJSON-1178517317 tempest-ImagesTestJSON-1178517317-project-member] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 890.945022] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 890.945182] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.945367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.945428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.945620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.945782] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.945887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.945958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.946274] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.946274] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.946354] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.976790] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: SUCCESS [ 890.977074] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.994139] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 890.994634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.994943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.995208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.995462] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.995585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.995765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.995812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.995891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.996031] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.017528] env[69491]: INFO networking_nsxv3.common.synchronization [req-b4eff379-0f2b-4657-80cf-784382b47b0a req-0aecaf41-a14b-421c-a3d7-a11e3d82ad02 tempest-ServersNegativeTestJSON-337259715 tempest-ServersNegativeTestJSON-337259715-project-member] Enqueued Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 891.018067] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 891.018609] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.018742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.018810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.019015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.019178] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.019281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.019367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.019491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.019573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.019665] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.113160] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 891.113379] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 deletion is rescheduled due to dependency. [ 891.113492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.210502] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-1174b667-c607-4471-b059-900f8b5c4de2 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.210693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.210747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.211141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.212698] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.212698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.212698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.212698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.212698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.212698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.212698] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-1174b667-c607-4471-b059-900f8b5c4de2 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.212698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.212698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.212698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.212698] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.213358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.213358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.213358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.213516] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.213516] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.213664] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1174b667-c607-4471-b059-900f8b5c4de2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.449019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.451026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.451026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.451026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.474940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.475360] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.475360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.475514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.475655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.475718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.475807] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 891.504226] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.504226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.504226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.504226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.504226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.504226] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.504226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.504226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.504226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.504226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.504226] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be updated. [ 891.506226] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.506359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.506423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.506585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.506717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.517845] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 891.524196] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.542772] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.542772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.542772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.542772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.542772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.554469] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: IN_PROGRESS for 2s [ 891.675425] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.675425] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.675425] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.675425] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.675425] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.675425] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.675425] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.675425] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.675425] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.679119] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.679510] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.679904] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.680265] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.680501] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.684034] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.684034] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.707044] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.707044] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 891.707044] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.707044] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.707044] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-d700a947-9217-4284-8b54-a99d0bd7472f taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.707044] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-d700a947-9217-4284-8b54-a99d0bd7472f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.707044] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-d700a947-9217-4284-8b54-a99d0bd7472f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.707044] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-d700a947-9217-4284-8b54-a99d0bd7472f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.707044] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d700a947-9217-4284-8b54-a99d0bd7472f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.719770] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1174b667-c607-4471-b059-900f8b5c4de2: rpc.has_security_group_logging(os_id): False [ 891.739276] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.739431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.739504] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.739719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.739806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.740020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.740132] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.740202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.740411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.740708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.740708] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.740812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.740901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.741301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.741403] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.741663] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.741929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.742037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.742246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.742345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.742464] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1174b667-c607-4471-b059-900f8b5c4de2 is going to be created. [ 891.807911] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.808176] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.808290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.811290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.811290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.827160] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1174b667-c607-4471-b059-900f8b5c4de2 in Status: IN_PROGRESS for 2s [ 892.026541] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.211799] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.213360] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.213360] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.213360] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.213360] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.213360] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port d700a947-9217-4284-8b54-a99d0bd7472f not found, creating... [ 892.213360] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.214246] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.214378] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.214630] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.214776] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.215104] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.215267] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.215457] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.215693] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.215833] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.217025] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: d700a947-9217-4284-8b54-a99d0bd7472f is going to be created. [ 892.250416] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.250653] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.250783] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.252665] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.252998] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.253309] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-d700a947-9217-4284-8b54-a99d0bd7472f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.529640] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.529877] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.529955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.530223] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.530324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.530485] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 is going to be updated. [ 892.567041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.567041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.567041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.567041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.567041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.575536] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: IN_PROGRESS for 2s [ 893.313666] env[69491]: INFO networking_nsxv3.common.synchronization [None req-e9069f9e-7e4f-4efb-b7b9-fef2e6a356ca None None] Enqueued Resource ID: 3e89f969-4da6-422d-a8e4-1c29487d03fb with Priority: HIGHEST for action port [ 893.315500] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e89f969-4da6-422d-a8e4-1c29487d03fb with Priority: HIGHEST for action port [ 893.315941] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e89f969-4da6-422d-a8e4-1c29487d03fb taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.316135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e89f969-4da6-422d-a8e4-1c29487d03fb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.316308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e89f969-4da6-422d-a8e4-1c29487d03fb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.316559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e89f969-4da6-422d-a8e4-1c29487d03fb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.316658] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e89f969-4da6-422d-a8e4-1c29487d03fb',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.421251] env[69491]: INFO networking_nsxv3.common.synchronization [None req-f31fcd6f-a483-4847-8e49-3eb907ad7dc2 tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGHEST for action security_group_rules [ 893.421251] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGHEST for action security_group_rules [ 893.421428] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.421428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.421574] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.422419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.422419] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d029d7dd-2e40-4077-9e65-c77ae878eeb1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.533239] env[69491]: INFO networking_nsxv3.common.synchronization [req-88077025-e84e-4115-9717-c364cbfbac96 req-3229d4c7-2950-4502-958c-6029045e91db service nova] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_rules [ 893.533239] env[69491]: INFO networking_nsxv3.common.synchronization [req-88077025-e84e-4115-9717-c364cbfbac96 req-3229d4c7-2950-4502-958c-6029045e91db service nova] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 893.533239] env[69491]: INFO networking_nsxv3.common.synchronization [req-88077025-e84e-4115-9717-c364cbfbac96 req-3229d4c7-2950-4502-958c-6029045e91db service nova] Enqueued Resource ID: d700a947-9217-4284-8b54-a99d0bd7472f with Priority: HIGHEST for action port [ 893.533239] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 893.533239] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 deletion is rescheduled due to dependency. [ 893.533239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.534201] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_rules [ 893.534441] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 893.534647] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d700a947-9217-4284-8b54-a99d0bd7472f with Priority: HIGHEST for action port [ 893.535274] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.535628] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.535781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.536154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.536345] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.540355] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.540593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.540814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.541089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.541338] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.541683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.544677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.544677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.544677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.544677] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.544677] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d700a947-9217-4284-8b54-a99d0bd7472f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.544677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d700a947-9217-4284-8b54-a99d0bd7472f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.544677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d700a947-9217-4284-8b54-a99d0bd7472f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.544677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d700a947-9217-4284-8b54-a99d0bd7472f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.544677] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d700a947-9217-4284-8b54-a99d0bd7472f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.561681] env[69491]: INFO networking_nsxv3.common.synchronization [None req-56db92c5-fd3e-419d-8ffe-67a3cf37a602 tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGHEST for action security_group_rules [ 893.561865] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGHEST for action security_group_rules [ 893.562206] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.562322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.563336] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415ca665-bf4f-490e-98cb-4ba509031109 in Status: SUCCESS [ 893.563605] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 deletion is rescheduled due to dependency. [ 893.563605] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.819335] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e89f969-4da6-422d-a8e4-1c29487d03fb [ 893.819587] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.819723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.819793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.820029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.820119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.820222] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e89f969-4da6-422d-a8e4-1c29487d03fb already deleted. [ 893.820303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e89f969-4da6-422d-a8e4-1c29487d03fb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.841366] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1174b667-c607-4471-b059-900f8b5c4de2 in Status: SUCCESS [ 893.841599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.942798] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.942975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.943059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.943298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.943384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.943480] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 already deleted. [ 893.943561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.943716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.943873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.943951] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d029d7dd-2e40-4077-9e65-c77ae878eeb1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.047957] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.047957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.048833] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.049873] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d700a947-9217-4284-8b54-a99d0bd7472f with status ACTIVE [ 894.050117] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.050245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.050423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.050564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.050681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.050887] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.050992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.057805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.057805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.057805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.057805] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.057805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.057805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.057805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.057805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.057805] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d700a947-9217-4284-8b54-a99d0bd7472f is going to be updated. [ 894.085187] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.085345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.085434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.085647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.085790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.085955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d700a947-9217-4284-8b54-a99d0bd7472f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.471100] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.471100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.471100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.471515] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.471609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.474739] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 already deleted. [ 894.474739] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.558537] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.586823] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: SUCCESS [ 894.586823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.060809] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.061181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.061342] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.061690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.061925] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.062125] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 895.098445] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.102514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.103643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.103790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.103948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.114847] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 895.661580] env[69491]: INFO networking_nsxv3.common.synchronization [None req-31a15053-8844-49ae-8785-b484c179dfc1 None None] Enqueued Resource ID: 7facc732-9570-44f0-9ce7-5f3fb0b7100a with Priority: HIGHEST for action port [ 895.661836] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7facc732-9570-44f0-9ce7-5f3fb0b7100a with Priority: HIGHEST for action port [ 895.662719] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-7facc732-9570-44f0-9ce7-5f3fb0b7100a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.662846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7facc732-9570-44f0-9ce7-5f3fb0b7100a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.662918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7facc732-9570-44f0-9ce7-5f3fb0b7100a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.663397] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7facc732-9570-44f0-9ce7-5f3fb0b7100a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.663785] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7facc732-9570-44f0-9ce7-5f3fb0b7100a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.170906] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7facc732-9570-44f0-9ce7-5f3fb0b7100a [ 896.171201] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.171337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.171409] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.171630] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.171720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.171816] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7facc732-9570-44f0-9ce7-5f3fb0b7100a already deleted. [ 896.171897] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7facc732-9570-44f0-9ce7-5f3fb0b7100a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.206770] env[69491]: INFO networking_nsxv3.common.synchronization [req-eee9b4d0-db6f-44b8-9218-8e9f9f949bd6 req-342342f3-d930-42a2-a013-f3f599157a85 tempest-ServerActionsV293TestJSON-872204216 tempest-ServerActionsV293TestJSON-872204216-project-member] Enqueued Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGHEST for action security_group_members [ 896.207279] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGHEST for action security_group_members [ 896.207569] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c9d4b0f-923e-4454-badc-cbd5c63e211f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.207695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.207763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.207953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.208114] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.208213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.208275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.208420] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.208501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.208591] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c9d4b0f-923e-4454-badc-cbd5c63e211f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.711438] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.711810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.711810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.711876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.742476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.746328] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.746328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.746328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.746328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.746328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.746328] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f is going to be updated. [ 896.785289] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.785434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.785538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.785763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.785913] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.798262] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f in Status: IN_PROGRESS for 2s [ 897.125262] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 897.125704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.125951] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.126312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.126582] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.126769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.126865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.127094] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.127228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.127360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.127514] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.629825] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.629994] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.630086] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.630349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.630540] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.630654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.630723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.630890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.630977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.631083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.631331] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.631494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.631565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.631775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.632000] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.632261] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.632320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.632519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.632665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.632849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.633039] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.135712] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9028d23d-9b03-48da-a060-d720486e9412: rpc.has_security_group_logging(os_id): False [ 898.158420] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.158626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.158718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.158955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.159116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.159383] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.159531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.159626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.159825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.159958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.160247] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.160419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.160505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.160711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.160811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.162023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.162086] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.162143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.162365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.162675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.162675] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 898.232106] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.232106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.232106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.232106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.232106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.263491] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 898.808868] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f in Status: SUCCESS [ 898.809178] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f deletion is rescheduled due to dependency. [ 898.809304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.889008] env[69491]: INFO networking_nsxv3.common.synchronization [req-d8eb98e4-2927-44a3-8daa-4725ef2419bd req-4f3c9d55-59b2-45f7-b742-aaed2072bf9f tempest-ServersTestManualDisk-1552727568 tempest-ServersTestManualDisk-1552727568-project-member] Enqueued Resource ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f with Priority: HIGHEST for action security_group_members [ 898.889709] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f with Priority: HIGHEST for action security_group_members [ 898.890582] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.890773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.890873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.891153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.891411] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.891522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.891587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.891749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.891832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.891929] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.398552] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.398868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.398868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.399047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.399147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.399362] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.399478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.399537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.399704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.399778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.399864] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f already deleted. [ 899.399943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.506313] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-677 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.506561] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-677" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.507218] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-677" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.507218] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-677" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.507422] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.507628] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.507802] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.507964] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.508131] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.508578] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.508652] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.508849] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.508849] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.509034] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.509435] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.509526] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.533788] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.534018] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.534105] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.534304] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-677" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.534681] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-893770b2-2a69-44d1-be27-5f3bdec26e1d taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.534848] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-893770b2-2a69-44d1-be27-5f3bdec26e1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.534975] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-893770b2-2a69-44d1-be27-5f3bdec26e1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.535404] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-893770b2-2a69-44d1-be27-5f3bdec26e1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.535549] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('893770b2-2a69-44d1-be27-5f3bdec26e1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.038820] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.039085] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.039221] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.039511] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.039670] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.039831] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 893770b2-2a69-44d1-be27-5f3bdec26e1d not found, creating... [ 900.040109] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.040274] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.040405] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.040627] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.040770] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.041073] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.041240] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.041390] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.041628] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.041832] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.041916] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 893770b2-2a69-44d1-be27-5f3bdec26e1d is going to be created. [ 900.061877] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.062129] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.062238] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.062520] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.062767] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.062994] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-893770b2-2a69-44d1-be27-5f3bdec26e1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.276637] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 900.276903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.848463] env[69491]: INFO networking_nsxv3.common.synchronization [req-d8eb98e4-2927-44a3-8daa-4725ef2419bd req-587bcfca-4db5-460c-8fbe-095be8332ee3 service nova] Enqueued Resource ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f with Priority: HIGHEST for action security_group_rules [ 900.848463] env[69491]: INFO networking_nsxv3.common.synchronization [req-d8eb98e4-2927-44a3-8daa-4725ef2419bd req-587bcfca-4db5-460c-8fbe-095be8332ee3 service nova] Enqueued Resource ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f with Priority: HIGHEST for action security_group_members [ 900.848463] env[69491]: INFO networking_nsxv3.common.synchronization [req-d8eb98e4-2927-44a3-8daa-4725ef2419bd req-587bcfca-4db5-460c-8fbe-095be8332ee3 service nova] Enqueued Resource ID: 893770b2-2a69-44d1-be27-5f3bdec26e1d with Priority: HIGHEST for action port [ 900.848463] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f with Priority: HIGHEST for action security_group_rules [ 900.848463] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f with Priority: HIGHEST for action security_group_members [ 900.848463] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893770b2-2a69-44d1-be27-5f3bdec26e1d with Priority: HIGHEST for action port [ 900.848463] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.848463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.848463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.848463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.848463] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.848463] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.848463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.848463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.848463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.848463] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.848463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.848463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.849544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.849544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.849544] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.849903] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-893770b2-2a69-44d1-be27-5f3bdec26e1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.849984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-893770b2-2a69-44d1-be27-5f3bdec26e1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.850071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-893770b2-2a69-44d1-be27-5f3bdec26e1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.850227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-893770b2-2a69-44d1-be27-5f3bdec26e1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.850300] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('893770b2-2a69-44d1-be27-5f3bdec26e1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.352288] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.352288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.358100] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.359153] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 893770b2-2a69-44d1-be27-5f3bdec26e1d with status ACTIVE [ 901.359366] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.359511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.359554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.359763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.359851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.360036] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.360144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.360202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.360359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.360444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.360649] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.360787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.360867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.361082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.361141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.361290] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 893770b2-2a69-44d1-be27-5f3bdec26e1d is going to be updated. [ 901.383596] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.383748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.383851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.384016] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.384157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.384316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-893770b2-2a69-44d1-be27-5f3bdec26e1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.863754] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.367680] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.367905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.367905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.368141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.368181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.368290] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f is going to be created. [ 902.394309] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.394480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.394574] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.394863] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.395084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.407177] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f in Status: UNINITIALIZED for 2s [ 903.536927] env[69491]: INFO networking_nsxv3.common.synchronization [req-84406454-0084-4b34-a6aa-64e1d944e198 req-2962808f-07e6-4214-a747-1ad70cf332f4 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: 10542f81-ef97-4e2f-b99f-8956ec748760 with Priority: HIGHEST for action security_group_members [ 903.536927] env[69491]: INFO networking_nsxv3.common.synchronization [req-84406454-0084-4b34-a6aa-64e1d944e198 req-2962808f-07e6-4214-a747-1ad70cf332f4 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 903.536927] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10542f81-ef97-4e2f-b99f-8956ec748760 with Priority: HIGHEST for action security_group_members [ 903.536927] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 903.538831] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-10542f81-ef97-4e2f-b99f-8956ec748760 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.539115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.539283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.539597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.539979] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.540278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.540424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.540773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.540975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.541158] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10542f81-ef97-4e2f-b99f-8956ec748760',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.543226] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.543226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.543226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.543582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.543836] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.545636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.545636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.545636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.545636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.545636] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.627575] env[69491]: INFO networking_nsxv3.common.synchronization [req-84406454-0084-4b34-a6aa-64e1d944e198 req-2962808f-07e6-4214-a747-1ad70cf332f4 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: 10542f81-ef97-4e2f-b99f-8956ec748760 with Priority: HIGHEST for action security_group_rules [ 903.627575] env[69491]: INFO networking_nsxv3.common.synchronization [req-84406454-0084-4b34-a6aa-64e1d944e198 req-2962808f-07e6-4214-a747-1ad70cf332f4 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: 10542f81-ef97-4e2f-b99f-8956ec748760 with Priority: HIGHEST for action security_group_members [ 903.631019] env[69491]: INFO networking_nsxv3.common.synchronization [req-84406454-0084-4b34-a6aa-64e1d944e198 req-2962808f-07e6-4214-a747-1ad70cf332f4 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_rules [ 903.631019] env[69491]: INFO networking_nsxv3.common.synchronization [req-84406454-0084-4b34-a6aa-64e1d944e198 req-2962808f-07e6-4214-a747-1ad70cf332f4 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 903.631019] env[69491]: INFO networking_nsxv3.common.synchronization [req-84406454-0084-4b34-a6aa-64e1d944e198 req-2962808f-07e6-4214-a747-1ad70cf332f4 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: b7ad82ba-7c7d-4858-968b-038a324ce7ef with Priority: HIGHEST for action port [ 903.631019] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10542f81-ef97-4e2f-b99f-8956ec748760 with Priority: HIGHEST for action security_group_rules [ 903.631019] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_rules [ 903.631019] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7ad82ba-7c7d-4858-968b-038a324ce7ef with Priority: HIGHEST for action port [ 903.631019] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10542f81-ef97-4e2f-b99f-8956ec748760 with Priority: HIGHEST for action security_group_members [ 903.631019] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 903.631019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10542f81-ef97-4e2f-b99f-8956ec748760 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.631019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.631019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.631019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.631019] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10542f81-ef97-4e2f-b99f-8956ec748760',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.632885] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.633163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.633529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.633818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.633985] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.634901] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7ad82ba-7c7d-4858-968b-038a324ce7ef taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.635154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.635317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.635572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.637016] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7ad82ba-7c7d-4858-968b-038a324ce7ef',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.637016] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-10542f81-ef97-4e2f-b99f-8956ec748760 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.637016] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.637016] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.637016] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.047370] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10542f81-ef97-4e2f-b99f-8956ec748760',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.047460] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.140364] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.140364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.143207] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7ad82ba-7c7d-4858-968b-038a324ce7ef with status ACTIVE [ 904.143564] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.143746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.143847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.144130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.144248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.144484] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.144688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.144688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.144843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.144932] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.145181] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.145318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.145433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.145537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.145676] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.145739] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7ad82ba-7c7d-4858-968b-038a324ce7ef is going to be updated. [ 904.147610] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-10542f81-ef97-4e2f-b99f-8956ec748760 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.147810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.170280] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.170454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.170537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.170802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.170895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.171077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.362599] env[69491]: INFO networking_nsxv3.common.synchronization [req-c16214a7-83e9-4920-89f4-11c01e6467b5 req-2717eb19-9d33-4428-ad7f-a0f8cbf48d61 tempest-InstanceActionsTestJSON-1668801794 tempest-InstanceActionsTestJSON-1668801794-project-member] Enqueued Resource ID: 1174b667-c607-4471-b059-900f8b5c4de2 with Priority: HIGHEST for action security_group_members [ 904.363197] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1174b667-c607-4471-b059-900f8b5c4de2 with Priority: HIGHEST for action security_group_members [ 904.363554] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-1174b667-c607-4471-b059-900f8b5c4de2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.363708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.363777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.364076] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.364268] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.364380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.364459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.364842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.364970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.366418] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1174b667-c607-4471-b059-900f8b5c4de2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.384614] env[69491]: INFO networking_nsxv3.common.synchronization [req-a00c88fa-0f15-4f38-ab48-58d7ae924090 req-084416aa-d5e6-4bc9-a5f6-49d19f75649f tempest-VolumesAdminNegativeTest-1366311223 tempest-VolumesAdminNegativeTest-1366311223-project-member] Enqueued Resource ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 with Priority: HIGHEST for action security_group_members [ 904.385248] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 with Priority: HIGHEST for action security_group_members [ 904.385656] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.385823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.385884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.386141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.386318] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.386443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.386476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.387460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.387460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.387460] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.418577] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f in Status: SUCCESS [ 904.418837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.419612] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.419866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.420115] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.420243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.420310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.420470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.420554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.421182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.421332] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.472521] env[69491]: INFO networking_nsxv3.common.synchronization [req-79e3c983-4490-43f8-bc83-7fcadbcb520e req-a2adf52e-3f6e-4fb1-9057-0c0cb20cca10 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: 10542f81-ef97-4e2f-b99f-8956ec748760 with Priority: HIGHEST for action security_group_members [ 904.472738] env[69491]: INFO networking_nsxv3.common.synchronization [req-79e3c983-4490-43f8-bc83-7fcadbcb520e req-a2adf52e-3f6e-4fb1-9057-0c0cb20cca10 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 904.473417] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10542f81-ef97-4e2f-b99f-8956ec748760 with Priority: HIGHEST for action security_group_members [ 904.473697] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 904.474592] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-10542f81-ef97-4e2f-b99f-8956ec748760 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.475217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.475217] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.475217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.549808] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10542f81-ef97-4e2f-b99f-8956ec748760',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.551020] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.574151] env[69491]: INFO networking_nsxv3.common.synchronization [req-79e3c983-4490-43f8-bc83-7fcadbcb520e req-a2adf52e-3f6e-4fb1-9057-0c0cb20cca10 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_rules [ 904.574360] env[69491]: INFO networking_nsxv3.common.synchronization [req-79e3c983-4490-43f8-bc83-7fcadbcb520e req-a2adf52e-3f6e-4fb1-9057-0c0cb20cca10 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 904.574510] env[69491]: INFO networking_nsxv3.common.synchronization [req-79e3c983-4490-43f8-bc83-7fcadbcb520e req-a2adf52e-3f6e-4fb1-9057-0c0cb20cca10 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: b7ad82ba-7c7d-4858-968b-038a324ce7ef with Priority: HIGHEST for action port [ 904.575696] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_rules [ 904.575696] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 904.575696] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7ad82ba-7c7d-4858-968b-038a324ce7ef with Priority: HIGHEST for action port [ 904.575696] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.575696] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.579983] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.579983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.579983] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7ad82ba-7c7d-4858-968b-038a324ce7ef taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.579983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.579983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.579983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.579983] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7ad82ba-7c7d-4858-968b-038a324ce7ef',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.868470] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.868640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.868714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.868941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.869050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.869262] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.869367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.869426] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.869594] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.869672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.869760] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1174b667-c607-4471-b059-900f8b5c4de2 is going to be updated. [ 904.889279] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.890318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.890318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.890318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.890318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.890318] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.890318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.890318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.890675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.890675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.890747] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 already deleted. [ 904.890831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.900790] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.900978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.901057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.901314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.901529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.913868] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1174b667-c607-4471-b059-900f8b5c4de2 in Status: IN_PROGRESS for 2s [ 904.925136] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.945427] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-77 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.945728] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-77" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.945938] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-77" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.946276] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-77" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.946956] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.947157] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.947288] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.947543] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.947699] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.947920] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.949052] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.949052] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.949052] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.949052] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.949052] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.949240] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.978329] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.978597] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 904.978694] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.978919] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-77" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.979387] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.979573] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.980495] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.980837] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.981018] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.055956] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.056410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.056590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.056902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.057227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.058640] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10542f81-ef97-4e2f-b99f-8956ec748760 is going to be created. [ 905.058894] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.059020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.059092] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.059294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.059373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.059480] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 is going to be updated. [ 905.086771] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7ad82ba-7c7d-4858-968b-038a324ce7ef with status ACTIVE [ 905.087050] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.087192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.087258] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.087478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.088204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.088204] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.088204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.088204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.088204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.088204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.088452] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.088509] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.088582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.088724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.088795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.088896] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7ad82ba-7c7d-4858-968b-038a324ce7ef is going to be updated. [ 905.092014] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.093018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.093018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.093018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.093018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.095270] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.095399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.095452] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.095665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.095823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.108341] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10542f81-ef97-4e2f-b99f-8956ec748760 in Status: UNINITIALIZED for 2s [ 905.109243] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: IN_PROGRESS for 2s [ 905.125694] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.126036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.126132] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.126380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.126563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.126776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7ad82ba-7c7d-4858-968b-038a324ce7ef" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.426213] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f: rpc.has_security_group_logging(os_id): False [ 905.447350] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.447494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.447571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.447781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.447871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.448128] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.448229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.448295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.448455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.448531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.448617] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f is going to be created. [ 905.486709] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.486709] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.486920] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.487240] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.487422] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.487608] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4 not found, creating... [ 905.488293] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.488293] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.488293] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.488579] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.488635] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.488968] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.489189] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.489316] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.489661] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.490810] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.491113] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4 is going to be created. [ 905.513783] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.514065] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.514218] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.514570] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.514918] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.515177] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.526941] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.527163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.527242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.527722] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.528018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.540616] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f in Status: IN_PROGRESS for 2s [ 906.650845] env[69491]: INFO networking_nsxv3.common.synchronization [req-a00c88fa-0f15-4f38-ab48-58d7ae924090 req-cd4ee7b1-83be-47f8-9df7-461808eb8d70 service nova] Enqueued Resource ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 with Priority: HIGHEST for action security_group_rules [ 906.651145] env[69491]: INFO networking_nsxv3.common.synchronization [req-a00c88fa-0f15-4f38-ab48-58d7ae924090 req-cd4ee7b1-83be-47f8-9df7-461808eb8d70 service nova] Enqueued Resource ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 with Priority: HIGHEST for action security_group_members [ 906.651193] env[69491]: INFO networking_nsxv3.common.synchronization [req-a00c88fa-0f15-4f38-ab48-58d7ae924090 req-cd4ee7b1-83be-47f8-9df7-461808eb8d70 service nova] Enqueued Resource ID: a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4 with Priority: HIGHEST for action port [ 906.651939] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 with Priority: HIGHEST for action security_group_rules [ 906.652071] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 with Priority: HIGHEST for action security_group_members [ 906.652187] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4 with Priority: HIGHEST for action port [ 906.652500] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.652660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.652746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.653091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.653188] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.654859] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.655013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.658773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.658773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.658773] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.658773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.658773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.658773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.658773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.658773] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.658773] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.658773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.658773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.658773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.658773] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.925241] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1174b667-c607-4471-b059-900f8b5c4de2 in Status: SUCCESS [ 906.925745] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1174b667-c607-4471-b059-900f8b5c4de2 deletion is rescheduled due to dependency. [ 906.925745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.121202] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: SUCCESS [ 907.121436] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.121657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.121926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.122256] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.122348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.122385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.122532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.122648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.122757] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.127337] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10542f81-ef97-4e2f-b99f-8956ec748760 in Status: SUCCESS [ 907.127337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.127337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.127337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.127337] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.127337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.127337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.127337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.127337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.127337] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10542f81-ef97-4e2f-b99f-8956ec748760',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.155489] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.155489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.159104] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.167133] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4 with status ACTIVE [ 907.167133] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.167133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.167133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.167133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.167133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.167133] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.167133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.167133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.167133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.167133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.167133] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.167133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.167133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.167133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.167133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.167133] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4 is going to be updated. [ 907.191332] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.191332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.191332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.191332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.191332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.191332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0689b5e-d4d5-401b-b3fc-b9a6c9b2c0f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.556111] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f in Status: SUCCESS [ 907.556366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.625043] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.629044] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.629202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.629295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.629505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.629595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.630687] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.631035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.631207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.631504] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.631728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.631896] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10542f81-ef97-4e2f-b99f-8956ec748760 is going to be deleted. [ 907.663972] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.665849] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.666063] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.666146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.666353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.666444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.666688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.666995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.667127] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.667322] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.667486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.667570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.667750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.667860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.667978] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10542f81-ef97-4e2f-b99f-8956ec748760',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.128273] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.169569] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.169822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.169822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.170071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.170182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.170292] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 is going to be created. [ 908.171657] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.171796] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.171865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.173131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.173259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.173471] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.173580] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.173699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.173829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.173912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.174012] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10542f81-ef97-4e2f-b99f-8956ec748760 already deleted. [ 908.174105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.174203] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10542f81-ef97-4e2f-b99f-8956ec748760',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.175099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.175245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.175401] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.175497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.175561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.175713] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.175794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.175887] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10542f81-ef97-4e2f-b99f-8956ec748760',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.201712] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.201914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.202000] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.202255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.202469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.219217] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 in Status: UNINITIALIZED for 2s [ 908.635462] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.635646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.635727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.635970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.636095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.636198] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 is going to be updated. [ 908.665303] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.665738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.665738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.665738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.666193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.676345] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: IN_PROGRESS for 2s [ 908.677744] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10542f81-ef97-4e2f-b99f-8956ec748760',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.678783] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.678915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.678984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.679224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.679360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.679634] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.679758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.679823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.680190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.680190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.680294] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10542f81-ef97-4e2f-b99f-8956ec748760 already deleted. [ 908.680336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.181314] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10542f81-ef97-4e2f-b99f-8956ec748760: rpc.has_security_group_logging(os_id): False [ 909.227844] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.228095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.228227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.228546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.229362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.229721] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.229888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.229990] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.230290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.230421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.230562] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10542f81-ef97-4e2f-b99f-8956ec748760 is going to be created. [ 909.265667] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/10542f81-ef97-4e2f-b99f-8956ec748760], does not exist path=[/infra/domains/default/groups/10542f81-ef97-4e2f-b99f-8956ec748760]."\n}' [ 909.265923] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10542f81-ef97-4e2f-b99f-8956ec748760 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/10542f81-ef97-4e2f-b99f-8956ec748760 [ 909.266100] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 909.315575] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.316550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.316644] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.316867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.318607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.318959] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.320939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.320939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.320939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.320939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.320939] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.320939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.320939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.320939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.320939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.320939] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10542f81-ef97-4e2f-b99f-8956ec748760 is going to be created. [ 909.356169] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/10542f81-ef97-4e2f-b99f-8956ec748760], does not exist path=[/infra/domains/default/groups/10542f81-ef97-4e2f-b99f-8956ec748760]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/10542f81-ef97-4e2f-b99f-8956ec748760 [ 909.356377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10542f81-ef97-4e2f-b99f-8956ec748760" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.356931] env[69491]: Traceback (most recent call last): [ 909.356931] env[69491]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 909.356931] env[69491]: return func(*args, **kwargs) [ 909.357348] env[69491]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 909.357348] env[69491]: res.raise_for_status() [ 909.357348] env[69491]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 909.357348] env[69491]: raise HTTPError(http_error_msg, response=self) [ 909.357348] env[69491]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/10542f81-ef97-4e2f-b99f-8956ec748760 [ 909.357348] env[69491]: During handling of the above exception, another exception occurred: [ 909.357348] env[69491]: Traceback (most recent call last): [ 909.357348] env[69491]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 909.357348] env[69491]: listener.cb(fileno) [ 909.357348] env[69491]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 909.357348] env[69491]: result = function(*args, **kwargs) [ 909.357348] env[69491]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 909.357348] env[69491]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 909.357348] env[69491]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 909.357348] env[69491]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 909.357348] env[69491]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 909.357348] env[69491]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 909.357348] env[69491]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 909.357348] env[69491]: res.raise_for_status() [ 909.357348] env[69491]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 909.357348] env[69491]: raise HTTPError(http_error_msg, response=self) [ 909.357348] env[69491]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/10542f81-ef97-4e2f-b99f-8956ec748760 [ 909.357348] env[69491]: Removing descriptor: 23 [ 909.633925] env[69491]: INFO networking_nsxv3.common.synchronization [req-02182db2-7fe2-4870-ac5b-a8fec9a67922 req-a98016b0-01b2-4a3b-a45e-bf5bc4fd4c8d tempest-ListServerFiltersTestJSON-114866394 tempest-ListServerFiltersTestJSON-114866394-project-member] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 909.634789] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 909.634789] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.635030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.635030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.635272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.635373] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.635472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.635534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.635686] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.635767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.635896] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.040401] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.040863] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-356" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.040863] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-356" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.041385] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-356" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.045033] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.045033] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.045033] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.045033] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.045033] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.045033] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.045033] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.045033] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.045033] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.045033] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.045033] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.045033] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.071203] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.071395] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 910.071524] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.072109] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-356" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.072217] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-f4fdb571-afd5-465d-9338-1f7bd495cc86 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.072347] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-f4fdb571-afd5-465d-9338-1f7bd495cc86" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.072472] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-f4fdb571-afd5-465d-9338-1f7bd495cc86" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.072811] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-f4fdb571-afd5-465d-9338-1f7bd495cc86" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.072983] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4fdb571-afd5-465d-9338-1f7bd495cc86',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.138846] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.138846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.138846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.138846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.139154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.139260] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.139397] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.139443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.139603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.139718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.140888] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a783226f-a1df-4921-a642-6c211f5f8022 already deleted. [ 910.140888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.231318] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 in Status: SUCCESS [ 910.231318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.231526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.231815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.232085] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.232235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.232314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.232517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.232636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.232735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.232883] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.576923] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.577229] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.577408] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.577716] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.577957] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.578119] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port f4fdb571-afd5-465d-9338-1f7bd495cc86 not found, creating... [ 910.578456] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.578671] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.578817] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.579123] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.579536] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.579958] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.580179] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.580331] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.581406] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.581406] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.581406] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: f4fdb571-afd5-465d-9338-1f7bd495cc86 is going to be created. [ 910.623986] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.624245] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.624378] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.624704] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.625014] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.625274] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-f4fdb571-afd5-465d-9338-1f7bd495cc86" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.689578] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: SUCCESS [ 910.689884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.690443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.690443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.692310] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.692310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.692310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.692310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.692310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.692310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.692310] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.693103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.693442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.695482] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.695679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.695915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.696739] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.696939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.697080] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.736714] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.736916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.736993] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.737236] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.737416] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.737557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.737600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.737745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.737832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.737922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.738087] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.738208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.738273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.738418] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.738554] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.740749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.740749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.740749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.740749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.740749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.740749] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.199657] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.200751] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.200974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.243020] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017: rpc.has_security_group_logging(os_id): False [ 911.270035] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.270035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.270035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.270316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.270316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.270575] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.270698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.270770] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.270943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.271043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.271271] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.271636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.271636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.271820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.272025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.273341] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.273484] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.273618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.274035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.274318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.274684] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 is going to be created. [ 911.355993] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.355993] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.355993] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.355993] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.355993] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.384202] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 in Status: IN_PROGRESS for 2s [ 911.384202] env[69491]: INFO networking_nsxv3.common.synchronization [req-02182db2-7fe2-4870-ac5b-a8fec9a67922 req-658ef1d8-89d6-405c-8aad-a764da6c88f0 service nova] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_rules [ 911.387727] env[69491]: INFO networking_nsxv3.common.synchronization [req-02182db2-7fe2-4870-ac5b-a8fec9a67922 req-658ef1d8-89d6-405c-8aad-a764da6c88f0 service nova] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 911.387727] env[69491]: INFO networking_nsxv3.common.synchronization [req-02182db2-7fe2-4870-ac5b-a8fec9a67922 req-658ef1d8-89d6-405c-8aad-a764da6c88f0 service nova] Enqueued Resource ID: f4fdb571-afd5-465d-9338-1f7bd495cc86 with Priority: HIGHEST for action port [ 911.387727] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_rules [ 911.387727] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 911.387727] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4fdb571-afd5-465d-9338-1f7bd495cc86 with Priority: HIGHEST for action port [ 911.387727] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.387727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.387727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.389284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.389284] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.389284] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.389284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.389284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.389284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.389464] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.389464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.389530] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.389637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.389720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.389771] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.390551] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4fdb571-afd5-465d-9338-1f7bd495cc86 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.390718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4fdb571-afd5-465d-9338-1f7bd495cc86" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.390718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4fdb571-afd5-465d-9338-1f7bd495cc86" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.391451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4fdb571-afd5-465d-9338-1f7bd495cc86" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.391451] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4fdb571-afd5-465d-9338-1f7bd495cc86',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.701861] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.896161] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.896161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.896161] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4fdb571-afd5-465d-9338-1f7bd495cc86 with status ACTIVE [ 911.896161] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.896161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.896161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.896161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.896161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.896161] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.896161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.896161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.896161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.896161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.896161] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.896613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.896613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.896613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.896613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.896613] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4fdb571-afd5-465d-9338-1f7bd495cc86 is going to be updated. [ 911.900107] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.927425] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.927598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.927636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.927850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.927982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.928151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4fdb571-afd5-465d-9338-1f7bd495cc86" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.207951] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.208224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.208479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.208630] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.208801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.208967] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 is going to be updated. [ 912.251639] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.251828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.251873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.252084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.252241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.263355] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: IN_PROGRESS for 2s [ 912.403555] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.786163] env[69491]: INFO networking_nsxv3.common.synchronization [req-3a48bfb8-847e-42bf-9969-ed19ebb05aab req-91946aaa-5d19-48cb-b93e-bd2502aa1c3f tempest-ListServerFiltersTestJSON-114866394 tempest-ListServerFiltersTestJSON-114866394-project-member] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 912.786727] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 912.787062] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.787163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.911333] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.911333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.911333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.911333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.911333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.911333] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a783226f-a1df-4921-a642-6c211f5f8022 is going to be created. [ 912.945148] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.945148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.945148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.945148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.945148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.960228] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: UNINITIALIZED for 2s [ 913.120182] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.120408] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-356" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.120583] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-356" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.120823] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-356" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.121102] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.121268] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.121389] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.121599] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.121820] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.122023] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.122393] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.122578] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.122724] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.122850] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.122964] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.123144] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.143339] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.143556] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 913.143686] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.143907] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-356" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.144710] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-89965300-bd8b-448d-b163-2b584e4f8d9d taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.144710] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-89965300-bd8b-448d-b163-2b584e4f8d9d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.145016] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-89965300-bd8b-448d-b163-2b584e4f8d9d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.145108] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-89965300-bd8b-448d-b163-2b584e4f8d9d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.145280] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89965300-bd8b-448d-b163-2b584e4f8d9d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.399041] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 in Status: SUCCESS [ 913.399519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.649354] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.649518] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.649675] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.650016] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.650202] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.650373] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 89965300-bd8b-448d-b163-2b584e4f8d9d not found, creating... [ 913.650675] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.650848] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.651011] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.651288] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.651450] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.651774] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.651969] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.652110] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.652350] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.652493] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.652641] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 89965300-bd8b-448d-b163-2b584e4f8d9d is going to be created. [ 913.682598] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.682915] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.683082] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.683425] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.683721] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.683990] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-89965300-bd8b-448d-b163-2b584e4f8d9d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.757255] env[69491]: INFO networking_nsxv3.common.synchronization [req-1475d569-5511-4d25-8d2a-8f3eff52f8ff req-c0be27eb-08d1-41a3-8091-eb85964cf363 tempest-ServerRescueTestJSONUnderV235-920339121 tempest-ServerRescueTestJSONUnderV235-920339121-project-member] Enqueued Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 913.758135] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 with Priority: HIGHEST for action security_group_members [ 913.759146] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.759146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.273238] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: SUCCESS [ 914.273473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.273646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.273890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.274322] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.274322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.274322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.274489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.274527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.274600] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.378840] env[69491]: INFO networking_nsxv3.common.synchronization [req-3a48bfb8-847e-42bf-9969-ed19ebb05aab req-fb52d1d3-f6bb-4bdd-ac93-0da6377418b7 service nova] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_rules [ 914.378840] env[69491]: INFO networking_nsxv3.common.synchronization [req-3a48bfb8-847e-42bf-9969-ed19ebb05aab req-fb52d1d3-f6bb-4bdd-ac93-0da6377418b7 service nova] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 914.378840] env[69491]: INFO networking_nsxv3.common.synchronization [req-3a48bfb8-847e-42bf-9969-ed19ebb05aab req-fb52d1d3-f6bb-4bdd-ac93-0da6377418b7 service nova] Enqueued Resource ID: 89965300-bd8b-448d-b163-2b584e4f8d9d with Priority: HIGHEST for action port [ 914.379679] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_rules [ 914.379811] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 914.379916] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89965300-bd8b-448d-b163-2b584e4f8d9d with Priority: HIGHEST for action port [ 914.380295] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.380410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.380628] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.380704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.380890] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-89965300-bd8b-448d-b163-2b584e4f8d9d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.381018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89965300-bd8b-448d-b163-2b584e4f8d9d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.381082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89965300-bd8b-448d-b163-2b584e4f8d9d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.381293] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89965300-bd8b-448d-b163-2b584e4f8d9d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.381375] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89965300-bd8b-448d-b163-2b584e4f8d9d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.776783] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.777066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.777066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.777281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.807763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.808748] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.808748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.808748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.808748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.808748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.808748] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 is going to be updated. [ 914.847920] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.848088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.848179] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.848399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.848558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.862748] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: IN_PROGRESS for 2s [ 914.883468] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89965300-bd8b-448d-b163-2b584e4f8d9d with status ACTIVE [ 914.883714] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.883857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.884985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.884985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.884985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.884985] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.884985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.884985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.885472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.885472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.885585] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.885685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.885782] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.886028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.886240] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.886360] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89965300-bd8b-448d-b163-2b584e4f8d9d is going to be updated. [ 914.914751] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.917090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.917207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.917460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.917611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.917776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89965300-bd8b-448d-b163-2b584e4f8d9d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.975174] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: SUCCESS [ 914.975425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.975616] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.975852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.976067] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.976183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.976292] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.976398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.976475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.976552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.976656] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.977803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.977803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.977963] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.978085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.978130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.978278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.978355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.978444] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.480965] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.484271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.484271] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.986350] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.489644] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.489996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.490096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.490373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.490606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.490807] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a783226f-a1df-4921-a642-6c211f5f8022 is going to be updated. [ 916.532938] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.533144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.533263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.533517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.533678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.545410] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: IN_PROGRESS for 2s [ 916.879490] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: SUCCESS [ 916.879652] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 deletion is rescheduled due to dependency. [ 916.879763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.880058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.880220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.880416] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.880542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.880611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.880774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.880898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.881186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.881346] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.881469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.881614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.881704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.881891] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.882061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.882061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.882198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.882301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.882357] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.882456] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.883500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.883675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.883838] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.883985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.884075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.884189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.884354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.884443] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.115029] env[69491]: INFO networking_nsxv3.common.synchronization [req-f10076aa-87e8-454c-8cbe-b9d349060a01 req-f84b83b7-1002-4011-b336-452359f467f2 tempest-ListImageFiltersTestJSON-361025592 tempest-ListImageFiltersTestJSON-361025592-project-member] Enqueued Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_members [ 917.115029] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGHEST for action security_group_members [ 917.115029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.115029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.115029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.115029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.115029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.115029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.115029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.115689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.115689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.115689] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.387047] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d564cdb5-54f1-4da6-8031-9d2e67dd8a08: rpc.has_security_group_logging(os_id): False [ 917.389356] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.389601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.389743] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.390067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.390188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.390469] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.390630] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.390630] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.390809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.390878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.390965] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 is going to be updated. [ 917.407210] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.407210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.407465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.407508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.407599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.407794] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.407896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.407958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.408130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.408203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.408407] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.408502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.408565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.408708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.408782] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.408969] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.409075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.409136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.409278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.409352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.409436] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 is going to be updated. [ 917.426623] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.426823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.427284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.427284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.427401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.437210] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: IN_PROGRESS for 2s [ 917.508459] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.508715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.508715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.508925] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.509082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.561889] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: IN_PROGRESS for 2s [ 917.618149] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.618363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.618448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.618769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.646193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.646290] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.646469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.646582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.646932] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.647080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.647217] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06871947-bfe0-4792-9f13-39942cbccdf7 is going to be updated. [ 917.682204] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.682349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.682418] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.682672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.682872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.694257] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: IN_PROGRESS for 2s [ 917.872812] env[69491]: INFO networking_nsxv3.common.synchronization [req-99b141df-28b8-454f-8d7a-5f37b229b69b req-0ef6659c-81b5-4b4f-9555-79a5fc8c79c1 tempest-ListServerFiltersTestJSON-114866394 tempest-ListServerFiltersTestJSON-114866394-project-member] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 917.873422] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 917.873766] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.873880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.260094] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.260622] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-356" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.260622] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-356" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.260792] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-356" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.261364] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.261614] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.261750] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.262103] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.262290] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.262539] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.262634] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.262754] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.262872] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.262996] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.263153] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.263301] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.296409] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.296610] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 918.296763] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.297027] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-356" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.297387] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-f996babb-8dc5-4ac3-ac9d-e41ece4e0d01 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.297573] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-f996babb-8dc5-4ac3-ac9d-e41ece4e0d01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.297717] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-f996babb-8dc5-4ac3-ac9d-e41ece4e0d01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.298094] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-f996babb-8dc5-4ac3-ac9d-e41ece4e0d01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.298252] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f996babb-8dc5-4ac3-ac9d-e41ece4e0d01',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.559465] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: SUCCESS [ 918.559465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.559465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.559465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.559600] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.559715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.559771] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.559971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.560073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.560193] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.801076] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.801076] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.801076] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.801316] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.801469] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.801696] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port f996babb-8dc5-4ac3-ac9d-e41ece4e0d01 not found, creating... [ 918.802115] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.802342] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.802526] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.802830] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.803060] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.803428] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.803678] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.803829] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.804150] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.804333] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.804536] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: f996babb-8dc5-4ac3-ac9d-e41ece4e0d01 is going to be created. [ 918.829563] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.829802] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.829936] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.830293] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.830614] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.830848] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-f996babb-8dc5-4ac3-ac9d-e41ece4e0d01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.063444] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.448338] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: SUCCESS [ 919.448720] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 deletion is rescheduled due to dependency. [ 919.448720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.569026] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.577256] env[69491]: INFO networking_nsxv3.common.synchronization [req-99b141df-28b8-454f-8d7a-5f37b229b69b req-226a8aaa-cf71-4804-b7a4-b809f621f3a9 service nova] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_rules [ 919.577459] env[69491]: INFO networking_nsxv3.common.synchronization [req-99b141df-28b8-454f-8d7a-5f37b229b69b req-226a8aaa-cf71-4804-b7a4-b809f621f3a9 service nova] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 919.577601] env[69491]: INFO networking_nsxv3.common.synchronization [req-99b141df-28b8-454f-8d7a-5f37b229b69b req-226a8aaa-cf71-4804-b7a4-b809f621f3a9 service nova] Enqueued Resource ID: f996babb-8dc5-4ac3-ac9d-e41ece4e0d01 with Priority: HIGHEST for action port [ 919.578736] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_rules [ 919.578890] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 919.578985] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f996babb-8dc5-4ac3-ac9d-e41ece4e0d01 with Priority: HIGHEST for action port [ 919.583027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.583027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.583027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.583027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.583027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f996babb-8dc5-4ac3-ac9d-e41ece4e0d01 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.583027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f996babb-8dc5-4ac3-ac9d-e41ece4e0d01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.583027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f996babb-8dc5-4ac3-ac9d-e41ece4e0d01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.583027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f996babb-8dc5-4ac3-ac9d-e41ece4e0d01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.583027] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f996babb-8dc5-4ac3-ac9d-e41ece4e0d01',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.583808] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 in Status: SUCCESS [ 919.584116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.585098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.585329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.585416] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d564cdb5-54f1-4da6-8031-9d2e67dd8a08',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.705965] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06871947-bfe0-4792-9f13-39942cbccdf7 in Status: SUCCESS [ 919.706147] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06871947-bfe0-4792-9f13-39942cbccdf7 deletion is rescheduled due to dependency. [ 919.706292] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.069377] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.069607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.069714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.070050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.070194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.070347] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a783226f-a1df-4921-a642-6c211f5f8022 is going to be updated. [ 920.087063] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f996babb-8dc5-4ac3-ac9d-e41ece4e0d01 with status ACTIVE [ 920.087318] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.087464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.087537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.087768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.087863] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.088065] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.089363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.089458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.089629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.089717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.089923] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.090048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.090110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.090247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.090325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.090447] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f996babb-8dc5-4ac3-ac9d-e41ece4e0d01 is going to be updated. [ 920.106685] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.106915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.106915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.107133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.107283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.110985] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.111166] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.111245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.111451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.111539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.111636] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d564cdb5-54f1-4da6-8031-9d2e67dd8a08 is going to be deleted. [ 920.116256] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.116402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.116486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.116669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.116804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.116967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f996babb-8dc5-4ac3-ac9d-e41ece4e0d01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.121029] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: IN_PROGRESS for 2s [ 920.171911] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.172233] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.172334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.172537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.172633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.172756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d564cdb5-54f1-4da6-8031-9d2e67dd8a08" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.917175] env[69491]: INFO networking_nsxv3.common.synchronization [req-f7bff001-9367-4ebf-95a5-2a5212361250 req-7a68f761-f164-41c4-8cb9-7e08ed683b66 tempest-VolumesAdminNegativeTest-1366311223 tempest-VolumesAdminNegativeTest-1366311223-project-member] Enqueued Resource ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 with Priority: HIGHEST for action security_group_members [ 920.917761] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 with Priority: HIGHEST for action security_group_members [ 920.918443] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.918443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.918443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.918645] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.918727] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.918823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.918893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.919252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.919364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.919485] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.424867] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.425045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.425089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.425494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.425598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.425828] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.425943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.426032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.426340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.426340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.426548] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 is going to be updated. [ 921.460485] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.460652] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.460652] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.461124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.461124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.470836] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 in Status: IN_PROGRESS for 2s [ 921.473488] env[69491]: INFO networking_nsxv3.common.synchronization [req-fb7dc4b3-32bc-418f-8bce-43f905f1f76a req-77f9bb59-3974-4c9a-a10c-02596fa92249 tempest-ServersWithSpecificFlavorTestJSON-938071933 tempest-ServersWithSpecificFlavorTestJSON-938071933-project-member] Enqueued Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_members [ 921.473999] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_members [ 921.474371] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.474629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.474629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.474756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.474898] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.474993] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.475087] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.475311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.475399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.475491] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.796918] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.797189] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-896" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.797331] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-896" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.797603] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-896" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.797867] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.798053] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.798191] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.798418] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.798570] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.798792] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 921.798914] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 921.799041] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 921.799171] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 921.799291] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 921.799403] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 921.799538] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 921.820297] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 921.820509] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 921.820655] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 921.820838] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-896" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.821205] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-424a6f45-0814-42f9-9dd6-dff5f0d91de3 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.821393] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-424a6f45-0814-42f9-9dd6-dff5f0d91de3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.821519] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-424a6f45-0814-42f9-9dd6-dff5f0d91de3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.821866] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-424a6f45-0814-42f9-9dd6-dff5f0d91de3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.821995] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('424a6f45-0814-42f9-9dd6-dff5f0d91de3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.978038] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.978038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.978038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.978038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.009792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.010172] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.010365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.010723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.010723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.010874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.010999] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53902bde-30e4-44b3-9472-853fecdeacca is going to be updated. [ 922.041542] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.041747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.041838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.042078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.042243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.053886] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: IN_PROGRESS for 2s [ 922.133079] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: SUCCESS [ 922.134557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.134557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.134557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.134557] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.134557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.134557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.134557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.134557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.134557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.135093] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.135093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.135093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.135093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.135093] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.135302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.135302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.135357] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.135450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.135556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.135655] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.139124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.139336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.139508] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.139619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.139683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.139823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.139899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.139994] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.324532] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.324532] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.324756] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.324888] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.325040] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.325267] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 424a6f45-0814-42f9-9dd6-dff5f0d91de3 not found, creating... [ 922.325554] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.325730] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.325846] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.326090] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.326240] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.326530] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.326706] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.326856] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.327120] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.327268] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.327416] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 424a6f45-0814-42f9-9dd6-dff5f0d91de3 is going to be created. [ 922.350179] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.351226] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.351226] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.351226] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.352101] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.352101] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-424a6f45-0814-42f9-9dd6-dff5f0d91de3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.641971] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.643123] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a783226f-a1df-4921-a642-6c211f5f8022: rpc.has_security_group_logging(os_id): False [ 922.668373] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.668373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.668373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.668373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.668373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.668373] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.668373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.668373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.668373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.668373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.668762] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.668762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.668762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.668875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.668915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.669105] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.669199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.669253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.669395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.669463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.669546] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a783226f-a1df-4921-a642-6c211f5f8022 is going to be created. [ 922.751628] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.751971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.753050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.753050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.753266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.770294] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: IN_PROGRESS for 2s [ 923.146716] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.186096] env[69491]: INFO networking_nsxv3.common.synchronization [req-fb7dc4b3-32bc-418f-8bce-43f905f1f76a req-de18efee-1227-4671-861b-edaf4770c417 service nova] Enqueued Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_rules [ 923.186893] env[69491]: INFO networking_nsxv3.common.synchronization [req-fb7dc4b3-32bc-418f-8bce-43f905f1f76a req-de18efee-1227-4671-861b-edaf4770c417 service nova] Enqueued Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_members [ 923.187082] env[69491]: INFO networking_nsxv3.common.synchronization [req-fb7dc4b3-32bc-418f-8bce-43f905f1f76a req-de18efee-1227-4671-861b-edaf4770c417 service nova] Enqueued Resource ID: 424a6f45-0814-42f9-9dd6-dff5f0d91de3 with Priority: HIGHEST for action port [ 923.187912] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_rules [ 923.188079] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_members [ 923.188162] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424a6f45-0814-42f9-9dd6-dff5f0d91de3 with Priority: HIGHEST for action port [ 923.188449] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.188931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.189029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.189233] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.189315] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.190260] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.190357] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.190551] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-424a6f45-0814-42f9-9dd6-dff5f0d91de3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.190654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-424a6f45-0814-42f9-9dd6-dff5f0d91de3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.190718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-424a6f45-0814-42f9-9dd6-dff5f0d91de3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.190889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-424a6f45-0814-42f9-9dd6-dff5f0d91de3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.190969] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('424a6f45-0814-42f9-9dd6-dff5f0d91de3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.480131] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 in Status: SUCCESS [ 923.480420] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017 deletion is rescheduled due to dependency. [ 923.480420] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.649065] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.649211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.649278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.649503] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.649596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.649701] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a783226f-a1df-4921-a642-6c211f5f8022 is going to be updated. [ 923.679488] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.679649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.679649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.680153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.680153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.694644] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.694849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.696215] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 424a6f45-0814-42f9-9dd6-dff5f0d91de3 with status ACTIVE [ 923.696410] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.696579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.696691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.696966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.697075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.697263] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.697374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.698483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.698483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.698483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.698483] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.698483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.698483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.698483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.698483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.698483] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 424a6f45-0814-42f9-9dd6-dff5f0d91de3 is going to be updated. [ 923.709425] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: IN_PROGRESS for 2s [ 923.723328] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.723695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.723695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.723853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.723996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.724255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-424a6f45-0814-42f9-9dd6-dff5f0d91de3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.065501] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: SUCCESS [ 924.065717] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53902bde-30e4-44b3-9472-853fecdeacca deletion is rescheduled due to dependency. [ 924.065871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.066108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.066422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.066648] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.066821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.066881] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.067021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.067117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.067239] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.569527] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.783752] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: SUCCESS [ 924.784030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.784223] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.784552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.784743] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.071847] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.290661] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.290937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.573727] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.574438] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.574646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.574914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.575029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.575244] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53902bde-30e4-44b3-9472-853fecdeacca is going to be updated. [ 925.607007] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.607199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.607242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.607476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.607633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.619236] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: IN_PROGRESS for 2s [ 925.720222] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: SUCCESS [ 925.720222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.720222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.720222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.720222] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.720222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.720222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.720222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.720583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.720583] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.223282] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.726442] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.229657] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.229949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.229949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.230171] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.230253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.230352] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a783226f-a1df-4921-a642-6c211f5f8022 is going to be updated. [ 927.271699] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.271922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.271991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.272295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.272536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.282159] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: IN_PROGRESS for 2s [ 927.631072] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: SUCCESS [ 927.631307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.632209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.632209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.632209] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.632209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.632209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.632602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.632602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.632602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.632602] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.134516] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.189140] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 928.189249] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 928.642707] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53902bde-30e4-44b3-9472-853fecdeacca: rpc.has_security_group_logging(os_id): False [ 928.668212] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.668212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.668212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.668212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.668212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.668212] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.668212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.668212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.668212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.668212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.668212] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53902bde-30e4-44b3-9472-853fecdeacca is going to be updated. [ 928.743012] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.743012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.743012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.743012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.743012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.757452] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: IN_PROGRESS for 2s [ 929.293795] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: SUCCESS [ 929.293795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.293795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.293795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.294218] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.294218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.294309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.294485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.294544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.294638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.294731] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.800020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.800020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.800020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.800020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.800020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.800020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.800020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.800020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.800020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.800020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.800020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.800020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.800020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.800557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.800557] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.800557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.800557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.800557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.800557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.800745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.800745] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.866328] env[69491]: INFO networking_nsxv3.common.synchronization [None req-b69326d8-3e80-499b-94ea-7ab73b88ecba None None] Enqueued Resource ID: 639b95f1-21ba-4a8a-9e04-8ba5f4da5a2e with Priority: HIGHEST for action port [ 929.867643] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 639b95f1-21ba-4a8a-9e04-8ba5f4da5a2e with Priority: HIGHEST for action port [ 929.868545] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-639b95f1-21ba-4a8a-9e04-8ba5f4da5a2e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.868545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-639b95f1-21ba-4a8a-9e04-8ba5f4da5a2e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.868545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-639b95f1-21ba-4a8a-9e04-8ba5f4da5a2e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.868545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-639b95f1-21ba-4a8a-9e04-8ba5f4da5a2e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.868545] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('639b95f1-21ba-4a8a-9e04-8ba5f4da5a2e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.990023] env[69491]: INFO networking_nsxv3.common.synchronization [req-5e04112f-5c8b-4a3f-bb61-aacf9af3bf79 req-18e7398c-0e8e-4fe5-913b-7b13dc86a475 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 929.990023] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 929.990023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.990023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.990023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.990023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.991308] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.991545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.991693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.991990] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.992323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.992529] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.307583] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a783226f-a1df-4921-a642-6c211f5f8022: rpc.has_security_group_logging(os_id): False [ 930.330280] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.330280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.330280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.330280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.333756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.333756] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.333756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.333756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.333756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.333756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.333756] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.333756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.333756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.333756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.333756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.333756] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.333756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.333756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.334267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.334267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.334267] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a783226f-a1df-4921-a642-6c211f5f8022 is going to be updated. [ 930.356143] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-580 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.356353] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.356486] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.356785] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.362028] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.362028] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.362028] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.362028] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.362028] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.362028] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.362028] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.362028] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.362028] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.362028] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.362028] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.362028] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.370436] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 639b95f1-21ba-4a8a-9e04-8ba5f4da5a2e [ 930.370658] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.371100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.371100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.371100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.371265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.371265] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:639b95f1-21ba-4a8a-9e04-8ba5f4da5a2e already deleted. [ 930.371334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-639b95f1-21ba-4a8a-9e04-8ba5f4da5a2e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.382945] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.383123] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 930.383227] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.383410] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.383734] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.383907] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.384046] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.384384] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.384687] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7a474ab-c3e7-4039-8d6f-9987b7a7a516',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.402328] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.402629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.402706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.402907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.406553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.417802] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: IN_PROGRESS for 2s [ 930.495135] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.772705] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: SUCCESS [ 930.772986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.891349] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.891611] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.891751] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.892054] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.892628] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.892628] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port f7a474ab-c3e7-4039-8d6f-9987b7a7a516 not found, creating... [ 930.892628] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.892815] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.892926] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.893171] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.893346] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.893604] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.893770] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.893906] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.894143] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.894283] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.894398] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: f7a474ab-c3e7-4039-8d6f-9987b7a7a516 is going to be created. [ 930.918479] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.918864] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.918947] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.919317] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.919616] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.919975] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.997702] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.501020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.501454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.501454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.501526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.501578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.501682] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 931.534069] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.534250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.534491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.534491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.534823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.545016] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 931.647078] env[69491]: INFO networking_nsxv3.common.synchronization [req-5e04112f-5c8b-4a3f-bb61-aacf9af3bf79 req-c1c130f0-14cd-44c1-9ec7-307ea2211406 service nova] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_rules [ 931.647283] env[69491]: INFO networking_nsxv3.common.synchronization [req-5e04112f-5c8b-4a3f-bb61-aacf9af3bf79 req-c1c130f0-14cd-44c1-9ec7-307ea2211406 service nova] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 931.647428] env[69491]: INFO networking_nsxv3.common.synchronization [req-5e04112f-5c8b-4a3f-bb61-aacf9af3bf79 req-c1c130f0-14cd-44c1-9ec7-307ea2211406 service nova] Enqueued Resource ID: f7a474ab-c3e7-4039-8d6f-9987b7a7a516 with Priority: HIGHEST for action port [ 931.648249] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_rules [ 931.648389] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 931.648490] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a474ab-c3e7-4039-8d6f-9987b7a7a516 with Priority: HIGHEST for action port [ 931.648792] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.648919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.648980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.649211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.649261] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.650116] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.650291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.650393] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.650497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.650568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.650751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.650838] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7a474ab-c3e7-4039-8d6f-9987b7a7a516',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.091353] env[69491]: INFO networking_nsxv3.common.synchronization [None req-79720898-76c8-4863-97ad-68ca42cd1f4a None None] Enqueued Resource ID: ec44f8ed-5f46-40be-b7cf-b0c0a79e5f59 with Priority: HIGHEST for action port [ 932.091612] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec44f8ed-5f46-40be-b7cf-b0c0a79e5f59 with Priority: HIGHEST for action port [ 932.092222] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec44f8ed-5f46-40be-b7cf-b0c0a79e5f59 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.092346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec44f8ed-5f46-40be-b7cf-b0c0a79e5f59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.092432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec44f8ed-5f46-40be-b7cf-b0c0a79e5f59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.092667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec44f8ed-5f46-40be-b7cf-b0c0a79e5f59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.092751] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec44f8ed-5f46-40be-b7cf-b0c0a79e5f59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.152695] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.152839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.157062] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7a474ab-c3e7-4039-8d6f-9987b7a7a516 with status ACTIVE [ 932.157062] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.157062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.157062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.157304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.157304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.157482] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.157579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.157639] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.157779] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.157849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.158060] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.158136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.158180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.159024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.159024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.159024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7a474ab-c3e7-4039-8d6f-9987b7a7a516 is going to be updated. [ 932.187487] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.187487] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.188341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.188341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.188341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.188341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.434899] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: SUCCESS [ 932.434899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.436356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.438105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.438275] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.595261] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec44f8ed-5f46-40be-b7cf-b0c0a79e5f59 [ 932.596346] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.596346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.596346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.596815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.598531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.598719] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec44f8ed-5f46-40be-b7cf-b0c0a79e5f59 already deleted. [ 932.598871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec44f8ed-5f46-40be-b7cf-b0c0a79e5f59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.940815] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.941047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.941047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.941278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.941804] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.941804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.941804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.941804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.941943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.941943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.941999] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.449360] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.449462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.449526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.449754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.449973] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.450116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.450157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.450322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.450411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.450500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.450650] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.450746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.450854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.450945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.451088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.451182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.451262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.451374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.451447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.451527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.451656] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.555435] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 933.555817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.555957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.556257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.557876] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.557876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.557876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.557876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.557876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.557876] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.955007] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a783226f-a1df-4921-a642-6c211f5f8022: rpc.has_security_group_logging(os_id): False [ 933.977256] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.977454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.977534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.977834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.977969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.978245] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.978368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.978413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.978562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.978640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.978823] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.978963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.979254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.979467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.979646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.979986] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.980205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.980357] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.980572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.980712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.980846] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a783226f-a1df-4921-a642-6c211f5f8022 is going to be updated. [ 934.052395] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.052638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.052638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.052907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.053102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.060152] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.074490] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: IN_PROGRESS for 2s [ 934.562397] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.064777] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.065215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.065215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.065299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.065350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.065458] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 935.098422] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.100042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.100042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.100042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.100042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.111878] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 936.094418] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: SUCCESS [ 936.094685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.092831] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 937.092940] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 937.122133] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 937.122494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.122532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.122802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.123010] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.123204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.123204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.123382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.123428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.123505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.123595] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.593340] env[69491]: INFO networking_nsxv3.common.synchronization [req-472e1cfc-c395-4636-a1e0-cbf037e5d7f0 req-18fb61b8-a709-424e-af57-dc05b99b5472 tempest-ServersAdminTestJSON-362478418 tempest-ServersAdminTestJSON-362478418-project-member] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 937.593890] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 937.594659] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.594659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.594659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.594659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.594856] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.594856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.595015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.596691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.596691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.596691] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.625493] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.625652] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.625726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.626188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.626369] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.626475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.626542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.626692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.626776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.626864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.627025] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.627120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.627180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.627320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.627455] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.627543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.627600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.627734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.627806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.627885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.627973] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.907022] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.907022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.907022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.907022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.907022] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.907022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.907022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.907022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.907022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.907022] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 937.907022] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.907022] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.907022] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.907676] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 937.907676] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.907676] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.933516] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.933707] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 937.933857] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.934048] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.934379] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-0d4e3ac9-b0e6-400e-a847-5470b09d27a9 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.934567] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-0d4e3ac9-b0e6-400e-a847-5470b09d27a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.934724] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-0d4e3ac9-b0e6-400e-a847-5470b09d27a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.935053] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-0d4e3ac9-b0e6-400e-a847-5470b09d27a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.935202] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d4e3ac9-b0e6-400e-a847-5470b09d27a9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.101952] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.132831] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaa139e8-f09f-4a46-897a-d481019a63be: rpc.has_security_group_logging(os_id): False [ 938.151117] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.151302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.151379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.151661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.171969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.172277] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.172401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.172464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.172670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.172752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.172940] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.173044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.173111] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.173261] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.173346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.173532] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.173625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.173689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.173834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.173917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.174012] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 938.248036] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.248188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.248260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.248471] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.248617] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.265614] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 938.437964] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.437964] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.438243] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.438309] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.438442] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.438602] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 0d4e3ac9-b0e6-400e-a847-5470b09d27a9 not found, creating... [ 938.438872] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.439052] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.439202] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.439470] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.439627] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.439974] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.440275] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.440426] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.440652] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.440798] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.440948] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 0d4e3ac9-b0e6-400e-a847-5470b09d27a9 is going to be created. [ 938.464137] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.464137] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.464352] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.464688] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.465442] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.465442] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-0d4e3ac9-b0e6-400e-a847-5470b09d27a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.604281] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.107777] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.107777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.107946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.108209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.108305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.108442] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 939.137612] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.137910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.137910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.137996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.138155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.150280] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 939.158335] env[69491]: INFO networking_nsxv3.common.synchronization [req-472e1cfc-c395-4636-a1e0-cbf037e5d7f0 req-9431c65f-6942-48d7-9b18-715087964540 service nova] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_rules [ 939.158714] env[69491]: INFO networking_nsxv3.common.synchronization [req-472e1cfc-c395-4636-a1e0-cbf037e5d7f0 req-9431c65f-6942-48d7-9b18-715087964540 service nova] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 939.158714] env[69491]: INFO networking_nsxv3.common.synchronization [req-472e1cfc-c395-4636-a1e0-cbf037e5d7f0 req-9431c65f-6942-48d7-9b18-715087964540 service nova] Enqueued Resource ID: 0d4e3ac9-b0e6-400e-a847-5470b09d27a9 with Priority: HIGHEST for action port [ 939.158972] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_rules [ 939.159048] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 939.159182] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d4e3ac9-b0e6-400e-a847-5470b09d27a9 with Priority: HIGHEST for action port [ 939.159770] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.159899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.159970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.160221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.160307] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.163922] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.163922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.163922] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d4e3ac9-b0e6-400e-a847-5470b09d27a9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.163922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d4e3ac9-b0e6-400e-a847-5470b09d27a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.163922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d4e3ac9-b0e6-400e-a847-5470b09d27a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.163922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d4e3ac9-b0e6-400e-a847-5470b09d27a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.163922] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d4e3ac9-b0e6-400e-a847-5470b09d27a9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.667074] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.667258] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.667534] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d4e3ac9-b0e6-400e-a847-5470b09d27a9 with status ACTIVE [ 939.667665] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.667727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.667762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.667961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.668080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.668270] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.668780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.668780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.668780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.668780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.668936] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.668936] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.669020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.669140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.669212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.669297] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d4e3ac9-b0e6-400e-a847-5470b09d27a9 is going to be updated. [ 939.697518] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.697608] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.697688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.697903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.698055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.698217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d4e3ac9-b0e6-400e-a847-5470b09d27a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.283048] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 940.283048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.163528] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 941.164095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.165639] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.165919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.166295] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.166295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.166567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.166767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.166891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.167035] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.669669] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.876176] env[69491]: INFO networking_nsxv3.common.synchronization [req-52fa87ef-406b-440a-ac66-fef446a1c0ab req-0810130d-4459-4462-bf2a-0eebee1e025d tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_members [ 941.876373] env[69491]: INFO networking_nsxv3.common.synchronization [req-52fa87ef-406b-440a-ac66-fef446a1c0ab req-0810130d-4459-4462-bf2a-0eebee1e025d tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 941.877018] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_members [ 941.877309] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 941.877645] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-491f4d82-845e-4e02-b3d7-2b5c77772eb6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.877964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.877964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.878127] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.878297] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.878399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.878462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.878954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.879078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.879268] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.880068] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.880165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.880224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.882309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.882309] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.882309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.882309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.882309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.882309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.882309] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.967908] env[69491]: INFO networking_nsxv3.common.synchronization [req-52fa87ef-406b-440a-ac66-fef446a1c0ab req-0810130d-4459-4462-bf2a-0eebee1e025d tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_rules [ 941.967908] env[69491]: INFO networking_nsxv3.common.synchronization [req-52fa87ef-406b-440a-ac66-fef446a1c0ab req-0810130d-4459-4462-bf2a-0eebee1e025d tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_members [ 941.967908] env[69491]: INFO networking_nsxv3.common.synchronization [req-52fa87ef-406b-440a-ac66-fef446a1c0ab req-0810130d-4459-4462-bf2a-0eebee1e025d tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_rules [ 941.967908] env[69491]: INFO networking_nsxv3.common.synchronization [req-52fa87ef-406b-440a-ac66-fef446a1c0ab req-0810130d-4459-4462-bf2a-0eebee1e025d tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 941.967908] env[69491]: INFO networking_nsxv3.common.synchronization [req-52fa87ef-406b-440a-ac66-fef446a1c0ab req-0810130d-4459-4462-bf2a-0eebee1e025d tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: f7a474ab-c3e7-4039-8d6f-9987b7a7a516 with Priority: HIGHEST for action port [ 941.968335] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_rules [ 941.968454] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_rules [ 941.968557] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a474ab-c3e7-4039-8d6f-9987b7a7a516 with Priority: HIGHEST for action port [ 941.968665] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_members [ 941.968740] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 941.969028] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.969156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.969262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.969488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.969571] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.970492] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.970676] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.970676] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.970856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.970935] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.971748] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.971817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.972046] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.972179] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.972261] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7a474ab-c3e7-4039-8d6f-9987b7a7a516',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.973105] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-491f4d82-845e-4e02-b3d7-2b5c77772eb6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.973105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.973300] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.973395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.171893] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.386321] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.386321] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.474966] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-491f4d82-845e-4e02-b3d7-2b5c77772eb6 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.475206] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.476191] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.476191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.476191] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7a474ab-c3e7-4039-8d6f-9987b7a7a516 with status ACTIVE [ 942.476191] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.476191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.476191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.476542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.476542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.476633] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.476701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.476785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.476934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.477041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.477289] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.477418] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.477489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.477645] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.477723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.477813] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7a474ab-c3e7-4039-8d6f-9987b7a7a516 is going to be updated. [ 942.511419] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.511634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.511634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.511920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.512059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.512232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.674359] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.674833] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.674833] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.675025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.675352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.675619] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 942.715445] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.715687] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.715736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.715953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.716228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.733684] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 942.888171] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.889204] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.391671] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.391802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.391802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.392009] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.392112] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.392218] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 is going to be created. [ 943.393565] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.393683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.393753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.393923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.394020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.394109] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 943.420226] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.420394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.420470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.420707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.420900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.425486] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.425639] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.425735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.426020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.426237] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.435379] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 943.436037] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: UNINITIALIZED for 2s [ 944.744586] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 944.744904] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.745123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.745372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.745673] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.745829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.745917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.746114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.746225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.746336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.746449] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.248546] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.248753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.248814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.249087] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.249269] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.249376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.249442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.249604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.249690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.249778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.249927] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.250031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.250088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.250231] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.250475] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.250571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.250632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.250771] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.250846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.250928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.251131] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.447875] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 945.448069] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.448948] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: SUCCESS [ 945.449181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.449367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.449638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.449855] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.449980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.450060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.450221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.450303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.450402] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.451218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.451392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.451552] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.451656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.451719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.451858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.451931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.452029] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.753302] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebfca2b7-f089-437e-979a-24f210590561: rpc.has_security_group_logging(os_id): False [ 945.771960] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.772147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.772197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.773410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.790624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.790920] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.791251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.791362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.791557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.791647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.791872] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.791987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.792082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.792196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.792268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.792457] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.792560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.792626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.792744] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.792811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.792899] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 945.879464] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.879785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.879910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.880184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.880340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.896459] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 945.954885] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.956144] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.456836] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.458832] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.961291] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.961822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.961822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.961822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.961822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.962058] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 is going to be updated. [ 946.963304] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.963460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.963506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.963656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.963738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.963831] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 946.969824] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 946.969978] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 946.996455] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.996455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.996700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.996749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.996936] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.998612] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.998736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.998807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.998962] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.999103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.009088] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: IN_PROGRESS for 2s [ 947.009792] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 947.911288] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 947.911516] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.987566] env[69491]: INFO networking_nsxv3.common.synchronization [req-d3530a2e-066d-4ea9-8cb7-96bb6f95b4ee req-4377c476-1b84-4b83-814f-fda56e121da3 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 947.988418] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 947.988591] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.988718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.988785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.988986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.989151] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.989248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.989309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.989456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.989539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.989808] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.235467] env[69491]: INFO networking_nsxv3.common.synchronization [req-b74c7730-50f0-416a-a5d4-fc66c0831fd1 req-6441a1d3-2014-44cf-94c0-9d1f85bb15a1 tempest-ImagesNegativeTestJSON-2071510463 tempest-ImagesNegativeTestJSON-2071510463-project-member] Enqueued Resource ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 with Priority: HIGHEST for action security_group_members [ 948.236630] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 with Priority: HIGHEST for action security_group_members [ 948.237315] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a17d719d-b50f-4937-8fa1-f7b3109414a1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.237597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.237774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.238305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.238596] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.238764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.238856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.239123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.239249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.239385] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a17d719d-b50f-4937-8fa1-f7b3109414a1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.491683] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.491933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.491933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.492175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.492270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.492526] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.492636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.492701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.492859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.493170] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.493170] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be deleted. [ 948.518432] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.518747] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.518873] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.519246] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.519882] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.519882] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.520032] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.520291] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.520558] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.520853] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.521024] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.521200] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.521388] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.521454] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.521610] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.521834] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.523654] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.523654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.523805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.523880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.523982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.524092] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.541875] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.542581] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 948.542581] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.542581] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.542795] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-a96292c9-2785-4302-93df-c430338e396e taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.543153] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-a96292c9-2785-4302-93df-c430338e396e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.543153] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-a96292c9-2785-4302-93df-c430338e396e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.543620] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-a96292c9-2785-4302-93df-c430338e396e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.543620] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a96292c9-2785-4302-93df-c430338e396e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.646590] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-452 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.646802] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-452" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.646932] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-452" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.647640] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-452" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.647640] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.648053] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.648053] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.648180] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.648234] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.648447] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.648599] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.648684] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.648795] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.648911] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.649087] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.649158] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.669516] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.669652] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 948.669730] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.669907] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-452" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.670331] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-563cd6a1-c231-477c-9236-caa1c88f7310 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.671031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-563cd6a1-c231-477c-9236-caa1c88f7310" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.671031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-563cd6a1-c231-477c-9236-caa1c88f7310" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.671232] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-563cd6a1-c231-477c-9236-caa1c88f7310" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.671351] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('563cd6a1-c231-477c-9236-caa1c88f7310',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.742132] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.742304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.742375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.742619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.742712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.742912] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.743065] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.743138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.743324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.743407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.743498] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 already deleted. [ 948.743581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.021686] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: SUCCESS [ 949.022855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.022855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.022855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.022978] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.023047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.023139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.023422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.023541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.023666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.023800] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.025958] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 949.026269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.026531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.026813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.027365] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.027365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.027468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.028028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.028028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.028028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.028540] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.046426] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.046426] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.046426] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.046426] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.046585] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.046764] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port a96292c9-2785-4302-93df-c430338e396e not found, creating... [ 949.047103] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.047195] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.047276] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.047498] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.047663] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.047953] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.048128] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.048348] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.048595] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.048737] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.048885] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: a96292c9-2785-4302-93df-c430338e396e is going to be created. [ 949.068928] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.069282] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.069493] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.069806] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.070067] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.070300] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-a96292c9-2785-4302-93df-c430338e396e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.174605] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.174830] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.174966] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.175897] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.176087] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.176691] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 563cd6a1-c231-477c-9236-caa1c88f7310 not found, creating... [ 949.176691] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.176934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.176934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.177264] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.177432] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.177815] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.177952] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.178047] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.178360] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.178520] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.178675] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 563cd6a1-c231-477c-9236-caa1c88f7310 is going to be created. [ 949.216254] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.216254] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.216254] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.216254] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.216254] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.216254] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-563cd6a1-c231-477c-9236-caa1c88f7310" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.531101] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.532628] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.532787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.532828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.533087] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.533231] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.533344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.533412] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.533586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.533682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.533783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.533934] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.534195] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.534195] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.534279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.534360] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.534464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.534518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.534647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.534720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.534852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.534902] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.686679] env[69491]: INFO networking_nsxv3.common.synchronization [req-0a4ddefc-8878-49b0-9efb-c6c82091df48 req-a2e59fcc-2bdb-4f85-80ad-3726b1492f3e tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 789463b7-5fc9-4430-a16f-f50c87169e3f with Priority: HIGHEST for action security_group_members [ 949.686679] env[69491]: INFO networking_nsxv3.common.synchronization [req-0a4ddefc-8878-49b0-9efb-c6c82091df48 req-a2e59fcc-2bdb-4f85-80ad-3726b1492f3e tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 949.686679] env[69491]: INFO networking_nsxv3.common.synchronization [req-0a4ddefc-8878-49b0-9efb-c6c82091df48 req-a2e59fcc-2bdb-4f85-80ad-3726b1492f3e tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_members [ 949.686679] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789463b7-5fc9-4430-a16f-f50c87169e3f with Priority: HIGHEST for action security_group_members [ 949.686679] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 949.686679] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_members [ 949.686679] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-789463b7-5fc9-4430-a16f-f50c87169e3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.687472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.689492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.689991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.690810] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.692380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.692380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.692380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.692380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.692380] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('789463b7-5fc9-4430-a16f-f50c87169e3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.693218] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.693454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.693600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.693873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.694174] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.694536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.694731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.694976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.695162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.695366] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.698415] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-491f4d82-845e-4e02-b3d7-2b5c77772eb6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.698415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.698415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.698415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.698415] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.698415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.698415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.698415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.698415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.698415] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.736805] env[69491]: INFO networking_nsxv3.common.synchronization [req-0a4ddefc-8878-49b0-9efb-c6c82091df48 req-a2e59fcc-2bdb-4f85-80ad-3726b1492f3e tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_rules [ 949.736805] env[69491]: INFO networking_nsxv3.common.synchronization [req-0a4ddefc-8878-49b0-9efb-c6c82091df48 req-a2e59fcc-2bdb-4f85-80ad-3726b1492f3e tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_members [ 949.736805] env[69491]: INFO networking_nsxv3.common.synchronization [req-0a4ddefc-8878-49b0-9efb-c6c82091df48 req-a2e59fcc-2bdb-4f85-80ad-3726b1492f3e tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 789463b7-5fc9-4430-a16f-f50c87169e3f with Priority: HIGHEST for action security_group_rules [ 949.736805] env[69491]: INFO networking_nsxv3.common.synchronization [req-0a4ddefc-8878-49b0-9efb-c6c82091df48 req-a2e59fcc-2bdb-4f85-80ad-3726b1492f3e tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 789463b7-5fc9-4430-a16f-f50c87169e3f with Priority: HIGHEST for action security_group_members [ 949.736805] env[69491]: INFO networking_nsxv3.common.synchronization [req-0a4ddefc-8878-49b0-9efb-c6c82091df48 req-a2e59fcc-2bdb-4f85-80ad-3726b1492f3e tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_rules [ 949.736805] env[69491]: INFO networking_nsxv3.common.synchronization [req-0a4ddefc-8878-49b0-9efb-c6c82091df48 req-a2e59fcc-2bdb-4f85-80ad-3726b1492f3e tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 949.736805] env[69491]: INFO networking_nsxv3.common.synchronization [req-0a4ddefc-8878-49b0-9efb-c6c82091df48 req-a2e59fcc-2bdb-4f85-80ad-3726b1492f3e tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: f7a474ab-c3e7-4039-8d6f-9987b7a7a516 with Priority: HIGHEST for action port [ 949.737810] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_rules [ 949.738139] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789463b7-5fc9-4430-a16f-f50c87169e3f with Priority: HIGHEST for action security_group_rules [ 949.738453] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 949.738684] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a474ab-c3e7-4039-8d6f-9987b7a7a516 with Priority: HIGHEST for action port [ 949.738925] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_rules [ 949.739312] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_members [ 949.741474] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789463b7-5fc9-4430-a16f-f50c87169e3f with Priority: HIGHEST for action security_group_members [ 949.741474] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.741474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.741474] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-789463b7-5fc9-4430-a16f-f50c87169e3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.741474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.741474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.741474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.741474] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('789463b7-5fc9-4430-a16f-f50c87169e3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.742582] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.742839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.743178] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.743421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.743586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.744108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.744108] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7a474ab-c3e7-4039-8d6f-9987b7a7a516',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.746445] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.746445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.746445] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-491f4d82-845e-4e02-b3d7-2b5c77772eb6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.746445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.747017] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-789463b7-5fc9-4430-a16f-f50c87169e3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.747227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.898423] env[69491]: INFO networking_nsxv3.common.synchronization [req-d3530a2e-066d-4ea9-8cb7-96bb6f95b4ee req-ed43f214-2f8e-43fc-aafe-4e00707807d0 service nova] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_rules [ 949.898643] env[69491]: INFO networking_nsxv3.common.synchronization [req-d3530a2e-066d-4ea9-8cb7-96bb6f95b4ee req-ed43f214-2f8e-43fc-aafe-4e00707807d0 service nova] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 949.898792] env[69491]: INFO networking_nsxv3.common.synchronization [req-d3530a2e-066d-4ea9-8cb7-96bb6f95b4ee req-ed43f214-2f8e-43fc-aafe-4e00707807d0 service nova] Enqueued Resource ID: a96292c9-2785-4302-93df-c430338e396e with Priority: HIGHEST for action port [ 949.899370] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_rules [ 949.899507] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 949.899639] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a96292c9-2785-4302-93df-c430338e396e with Priority: HIGHEST for action port [ 949.899906] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.900059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.900124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.900332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.900413] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.905029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.905029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.905029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.905029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.905029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.905029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.905029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.905029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.905029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.905029] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.905029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-a96292c9-2785-4302-93df-c430338e396e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.905029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a96292c9-2785-4302-93df-c430338e396e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.905029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a96292c9-2785-4302-93df-c430338e396e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.905029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a96292c9-2785-4302-93df-c430338e396e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.905029] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a96292c9-2785-4302-93df-c430338e396e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.038415] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 491f4d82-845e-4e02-b3d7-2b5c77772eb6: rpc.has_security_group_logging(os_id): False [ 950.044492] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaa139e8-f09f-4a46-897a-d481019a63be: rpc.has_security_group_logging(os_id): False [ 950.047079] env[69491]: INFO networking_nsxv3.common.synchronization [req-b74c7730-50f0-416a-a5d4-fc66c0831fd1 req-8aaeb820-3a37-413a-9248-2b0a98b1ba1e service nova] Enqueued Resource ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 with Priority: HIGHEST for action security_group_rules [ 950.047233] env[69491]: INFO networking_nsxv3.common.synchronization [req-b74c7730-50f0-416a-a5d4-fc66c0831fd1 req-8aaeb820-3a37-413a-9248-2b0a98b1ba1e service nova] Enqueued Resource ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 with Priority: HIGHEST for action security_group_members [ 950.047346] env[69491]: INFO networking_nsxv3.common.synchronization [req-b74c7730-50f0-416a-a5d4-fc66c0831fd1 req-8aaeb820-3a37-413a-9248-2b0a98b1ba1e service nova] Enqueued Resource ID: 563cd6a1-c231-477c-9236-caa1c88f7310 with Priority: HIGHEST for action port [ 950.051052] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 with Priority: HIGHEST for action security_group_rules [ 950.051052] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 with Priority: HIGHEST for action security_group_members [ 950.051052] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563cd6a1-c231-477c-9236-caa1c88f7310 with Priority: HIGHEST for action port [ 950.051052] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a17d719d-b50f-4937-8fa1-f7b3109414a1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.051707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.051707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.051707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.051707] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a17d719d-b50f-4937-8fa1-f7b3109414a1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.053368] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a17d719d-b50f-4937-8fa1-f7b3109414a1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.053368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.053368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.053528] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.053563] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.053657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.053717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.054234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.054234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.054234] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a17d719d-b50f-4937-8fa1-f7b3109414a1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.055029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-563cd6a1-c231-477c-9236-caa1c88f7310 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.055168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-563cd6a1-c231-477c-9236-caa1c88f7310" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.055235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-563cd6a1-c231-477c-9236-caa1c88f7310" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.055384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-563cd6a1-c231-477c-9236-caa1c88f7310" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.055471] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('563cd6a1-c231-477c-9236-caa1c88f7310',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.067234] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.067234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.067234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.067234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.067234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.067234] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.067234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.067234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.068598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.068598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.068598] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 is going to be created. [ 950.069421] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.069553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.069599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.069763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.069843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.070054] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.070160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.070265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.070433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.070548] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.070715] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.070809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.070869] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.071020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.071091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.071311] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.071459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.071459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.071704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.071704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.071835] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 950.145120] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.145120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.145120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.145120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.145492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.154260] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.154422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.154534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.154838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.155576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.161076] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: IN_PROGRESS for 2s [ 950.174144] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 950.202187] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.203231] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('789463b7-5fc9-4430-a16f-f50c87169e3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.204132] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.252029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-789463b7-5fc9-4430-a16f-f50c87169e3f taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.252029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.252029] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7a474ab-c3e7-4039-8d6f-9987b7a7a516 with status ACTIVE [ 950.252029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.252029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.252029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.252029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.252029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.252029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.252029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.252029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.252029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.252029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.252029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.252969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.252969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.252969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.252969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.252969] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7a474ab-c3e7-4039-8d6f-9987b7a7a516 is going to be updated. [ 950.289791] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.290019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.290019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.290167] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.290307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.290471] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7a474ab-c3e7-4039-8d6f-9987b7a7a516" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.405575] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.405575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.408447] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.409243] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a96292c9-2785-4302-93df-c430338e396e with status ACTIVE [ 950.409335] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.409521] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.409521] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.409748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.409845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.410063] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.410238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.410282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.410463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.410664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.410798] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.410959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.411021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.411728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.411809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.411923] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a96292c9-2785-4302-93df-c430338e396e is going to be updated. [ 950.434775] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.434935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.435014] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.435236] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.435436] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.435607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a96292c9-2785-4302-93df-c430338e396e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.558118] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a17d719d-b50f-4937-8fa1-f7b3109414a1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.558118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.558316] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a17d719d-b50f-4937-8fa1-f7b3109414a1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.559173] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 563cd6a1-c231-477c-9236-caa1c88f7310 with status ACTIVE [ 950.559380] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.559685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.559685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.559804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.559851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.560053] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.560169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.560280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.560358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.560440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.560622] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.560716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.560797] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.560925] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.561879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.561879] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 563cd6a1-c231-477c-9236-caa1c88f7310 is going to be updated. [ 950.599542] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.599767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.599767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.599892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.600153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.600532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-563cd6a1-c231-477c-9236-caa1c88f7310" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.704637] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.705981] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('789463b7-5fc9-4430-a16f-f50c87169e3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.708679] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.734135] env[69491]: INFO networking_nsxv3.common.synchronization [req-7e24dc66-1eee-4920-be6e-812021814d14 req-931b1cd2-fcaa-488f-a4a6-710084f5ad62 tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 950.735065] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 950.735203] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.735354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.735485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.735849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.735849] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.735973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.736024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.736574] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.736794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.736947] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.914940] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.063617] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a17d719d-b50f-4937-8fa1-f7b3109414a1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.128148] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.131030] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.131030] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.131030] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.131030] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.131030] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.131030] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.131030] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.131030] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.131030] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.131030] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.131030] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.131030] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.131030] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.131030] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.131030] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.154426] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.154603] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 951.154749] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.154939] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.155550] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-bd715a94-be2f-4658-bae1-6d452fc377e0 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.155550] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-bd715a94-be2f-4658-bae1-6d452fc377e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.155771] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-bd715a94-be2f-4658-bae1-6d452fc377e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.156187] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-bd715a94-be2f-4658-bae1-6d452fc377e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.156399] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd715a94-be2f-4658-bae1-6d452fc377e0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.208489] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.208684] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.208747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.208926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.209019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.209115] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 951.210437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.210551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.210864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.210864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.210864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.210993] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 789463b7-5fc9-4430-a16f-f50c87169e3f is going to be created. [ 951.214458] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.214649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.214731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.214911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.214996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.215106] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 is going to be updated. [ 951.239725] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.239890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.239963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.240213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.240304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.240512] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.240613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.240680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.240838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.240915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.241008] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 already deleted. [ 951.241094] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.274831] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.275037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.275037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.275344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.275511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.280625] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.280774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.280847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.281087] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.281261] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.283156] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.283374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.283446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.283651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.283788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.293315] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 789463b7-5fc9-4430-a16f-f50c87169e3f in Status: UNINITIALIZED for 2s [ 951.294058] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: IN_PROGRESS for 2s [ 951.294628] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 951.420571] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.420571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.420571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.420860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.420860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.423203] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be created. [ 951.444906] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.445120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.445120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.445290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.445571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.455272] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: UNINITIALIZED for 2s [ 951.566675] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.566860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.566977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.567317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.567457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.567590] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 is going to be created. [ 951.598303] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.598479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.598754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.598850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.599077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.610036] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 in Status: UNINITIALIZED for 2s [ 951.658535] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.658836] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.658994] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.659318] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.659482] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.659650] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port bd715a94-be2f-4658-bae1-6d452fc377e0 not found, creating... [ 951.659924] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.660153] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.660291] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.660592] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.660753] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.661102] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.661290] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.661439] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.661668] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.661968] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.661968] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: bd715a94-be2f-4658-bae1-6d452fc377e0 is going to be created. [ 951.707915] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.707915] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.707915] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.707915] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.707915] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.707915] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-bd715a94-be2f-4658-bae1-6d452fc377e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.181027] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: SUCCESS [ 952.181027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.181547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.181547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.181547] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.203842] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 952.203842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.204336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.204336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.204336] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.422239] env[69491]: INFO networking_nsxv3.common.synchronization [req-7e24dc66-1eee-4920-be6e-812021814d14 req-1cfa274b-5cbc-4f04-b2bd-21e81cf2bc73 service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 952.429291] env[69491]: INFO networking_nsxv3.common.synchronization [req-7e24dc66-1eee-4920-be6e-812021814d14 req-1cfa274b-5cbc-4f04-b2bd-21e81cf2bc73 service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 952.429291] env[69491]: INFO networking_nsxv3.common.synchronization [req-7e24dc66-1eee-4920-be6e-812021814d14 req-1cfa274b-5cbc-4f04-b2bd-21e81cf2bc73 service nova] Enqueued Resource ID: bd715a94-be2f-4658-bae1-6d452fc377e0 with Priority: HIGHEST for action port [ 952.429291] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 952.429291] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 952.429291] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd715a94-be2f-4658-bae1-6d452fc377e0 with Priority: HIGHEST for action port [ 952.429291] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.429291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.429291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.429291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.429291] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.430972] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.431348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.431673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.432107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.432460] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.432752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.432952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.433336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.433588] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.434119] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.435582] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd715a94-be2f-4658-bae1-6d452fc377e0 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.435950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd715a94-be2f-4658-bae1-6d452fc377e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.436330] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd715a94-be2f-4658-bae1-6d452fc377e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.436840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd715a94-be2f-4658-bae1-6d452fc377e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.437199] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd715a94-be2f-4658-bae1-6d452fc377e0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.684227] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-491f4d82-845e-4e02-b3d7-2b5c77772eb6 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.684508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.707684] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.707937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.940015] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.941863] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.941863] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.941863] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd715a94-be2f-4658-bae1-6d452fc377e0 with status ACTIVE [ 952.941863] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.942164] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.942164] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.942266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.942358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.942986] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.942986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.942986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.942986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.942986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.943219] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.943219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.943219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.943440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.943539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.943627] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd715a94-be2f-4658-bae1-6d452fc377e0 is going to be updated. [ 952.972494] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.972755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.973064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.973136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.973286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.973465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd715a94-be2f-4658-bae1-6d452fc377e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.307224] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 789463b7-5fc9-4430-a16f-f50c87169e3f in Status: SUCCESS [ 953.307573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.307573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.307825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.308126] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.308328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.308459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.308667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.308796] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.308962] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('789463b7-5fc9-4430-a16f-f50c87169e3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.313483] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 953.313483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.313483] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: SUCCESS [ 953.313483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.313483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.313483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.313483] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.313483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.313483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.313483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.313483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.313483] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.313483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.313483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.313483] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.314575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.314575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.314575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.314575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.314575] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.445646] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.465515] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 953.466338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.466338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.466473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.466639] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.466783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.466856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.467066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.467163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.467269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.467373] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.621167] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 in Status: SUCCESS [ 953.621381] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.621574] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.621842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.622053] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.622276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.622276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.622474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.622474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.622566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.622639] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a17d719d-b50f-4937-8fa1-f7b3109414a1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.819023] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.819023] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('789463b7-5fc9-4430-a16f-f50c87169e3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.819023] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.950428] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.950428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.950428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.950428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.950428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.950428] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be created. [ 953.969479] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.969637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.969710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.969944] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.970134] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.970238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.970302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.970902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.970978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.971085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.971217] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.971315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.971371] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.971514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.971677] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.971740] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.971802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.971938] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.972841] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.972991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.973135] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.976589] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.976709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.977868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.977868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.977868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.989030] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: UNINITIALIZED for 2s [ 954.125832] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a17d719d-b50f-4937-8fa1-f7b3109414a1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.126107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.126107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.126750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.127056] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.127199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.127329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.127591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.127708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.127825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.128036] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a17d719d-b50f-4937-8fa1-f7b3109414a1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.128166] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.128250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.128429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.128601] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.128699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.128918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.129117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.129244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.129384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.129532] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a17d719d-b50f-4937-8fa1-f7b3109414a1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.324229] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.325192] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.327121] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('789463b7-5fc9-4430-a16f-f50c87169e3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.465532] env[69491]: INFO networking_nsxv3.common.synchronization [req-cfba56f9-3fb7-468a-9dba-8e2e50117a62 req-d1be9541-de2a-4956-9535-1d4352c06ea8 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 954.465532] env[69491]: INFO networking_nsxv3.common.synchronization [req-cfba56f9-3fb7-468a-9dba-8e2e50117a62 req-d1be9541-de2a-4956-9535-1d4352c06ea8 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 789463b7-5fc9-4430-a16f-f50c87169e3f with Priority: HIGHEST for action security_group_members [ 954.465532] env[69491]: INFO networking_nsxv3.common.synchronization [req-cfba56f9-3fb7-468a-9dba-8e2e50117a62 req-d1be9541-de2a-4956-9535-1d4352c06ea8 tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_members [ 954.465993] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 954.471489] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789463b7-5fc9-4430-a16f-f50c87169e3f with Priority: HIGHEST for action security_group_members [ 954.471489] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGHEST for action security_group_members [ 954.472219] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.472416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.472616] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-789463b7-5fc9-4430-a16f-f50c87169e3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.472715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.472914] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-491f4d82-845e-4e02-b3d7-2b5c77772eb6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.473119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.480430] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9632268c-db1a-4548-9652-b638bc84b886: rpc.has_security_group_logging(os_id): False [ 954.509539] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.509816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.509816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.513738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.513939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.514243] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.514374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.514444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.514681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.514767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.515034] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.515158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.515229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.515483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.515600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.515818] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.515982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.516033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.516432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.516432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.516432] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be created. [ 954.588024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.588024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.588024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.588024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.588024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.603311] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: IN_PROGRESS for 2s [ 954.634175] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a17d719d-b50f-4937-8fa1-f7b3109414a1: rpc.has_security_group_logging(os_id): False [ 954.681405] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.684075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.684075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.684075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.684075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.684075] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.684075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.684075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.684075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.684075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.684075] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.684075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.684075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.684075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.684075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.684723] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.684723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.684723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.684723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.684723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.684723] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 is going to be created. [ 954.779026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.779026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.779026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.779026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.779026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.794946] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 in Status: IN_PROGRESS for 2s [ 954.830031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.830031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.830031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.830031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.830031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.830031] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 is going to be updated. [ 954.831811] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.832251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.832526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.832948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.833220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.833511] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 954.835393] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.835746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.836134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.839030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.839030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.839030] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 789463b7-5fc9-4430-a16f-f50c87169e3f is going to be updated. [ 954.933023] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.933023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.933023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.933023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.933023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.934288] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.934646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.934822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.935171] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.935449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.938019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.939208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.939458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.939783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.940082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.965634] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: IN_PROGRESS for 2s [ 954.965634] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 789463b7-5fc9-4430-a16f-f50c87169e3f in Status: IN_PROGRESS for 2s [ 954.965634] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 955.208701] env[69491]: INFO networking_nsxv3.common.synchronization [None req-57b1d052-0e92-41d8-9d8c-3c92650bff7b tempest-ServerDiskConfigTestJSON-964931906 tempest-ServerDiskConfigTestJSON-964931906-project-member] Enqueued Resource ID: dbb9f0d0-82ef-4c86-9354-1a222fd32ec9 with Priority: HIGHEST for action security_group_rules [ 955.209331] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb9f0d0-82ef-4c86-9354-1a222fd32ec9 with Priority: HIGHEST for action security_group_rules [ 955.209627] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbb9f0d0-82ef-4c86-9354-1a222fd32ec9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.209757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbb9f0d0-82ef-4c86-9354-1a222fd32ec9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.209827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbb9f0d0-82ef-4c86-9354-1a222fd32ec9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.210499] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbb9f0d0-82ef-4c86-9354-1a222fd32ec9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.210587] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbb9f0d0-82ef-4c86-9354-1a222fd32ec9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.299635] env[69491]: INFO networking_nsxv3.common.synchronization [None req-80f1d07b-9656-4d1c-ba10-6075cfa24a25 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 955.299635] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 955.305900] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.305900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.305900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.305900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.305900] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.305900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.305900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.305900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.305900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.305900] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.395171] env[69491]: INFO networking_nsxv3.common.synchronization [None req-b74dc4b8-3049-4869-9290-05dff6628ab1 tempest-ServerDiskConfigTestJSON-964931906 tempest-ServerDiskConfigTestJSON-964931906-project-member] Enqueued Resource ID: dbb9f0d0-82ef-4c86-9354-1a222fd32ec9 with Priority: HIGHEST for action security_group_rules [ 955.398148] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb9f0d0-82ef-4c86-9354-1a222fd32ec9 with Priority: HIGHEST for action security_group_rules [ 955.398148] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbb9f0d0-82ef-4c86-9354-1a222fd32ec9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.398148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbb9f0d0-82ef-4c86-9354-1a222fd32ec9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.737835] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.737970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.738051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.738306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.738395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.738495] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbb9f0d0-82ef-4c86-9354-1a222fd32ec9 already deleted. [ 955.738577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbb9f0d0-82ef-4c86-9354-1a222fd32ec9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.738753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbb9f0d0-82ef-4c86-9354-1a222fd32ec9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.738920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbb9f0d0-82ef-4c86-9354-1a222fd32ec9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.738981] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbb9f0d0-82ef-4c86-9354-1a222fd32ec9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.809397] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.000573] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 956.003807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.003807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.003807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.003807] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.003807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.003807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.003807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.003807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.003807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.003807] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.270331] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.270472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.270472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.270793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.270898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.271027] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbb9f0d0-82ef-4c86-9354-1a222fd32ec9 already deleted. [ 956.271155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbb9f0d0-82ef-4c86-9354-1a222fd32ec9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.312229] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.372201] env[69491]: INFO networking_nsxv3.common.synchronization [req-da5720f5-49cf-459e-969d-5d0b2a4493aa req-ec0a223d-2b8b-49a1-92a3-20e607a5ae31 tempest-AttachInterfacesV270Test-1761351879 tempest-AttachInterfacesV270Test-1761351879-project-member] Enqueued Resource ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e with Priority: HIGHEST for action security_group_members [ 956.373166] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e with Priority: HIGHEST for action security_group_members [ 956.373354] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-21ffc58d-ad1f-4978-9447-c2859da9a03e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.373916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.373916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.373916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.374230] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.375322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.375322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.375322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.375322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.375322] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21ffc58d-ad1f-4978-9447-c2859da9a03e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.506105] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.507746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.507746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.507920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.508173] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.508372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.508482] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.508789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.508882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.509188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.509508] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.509737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.510455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.510455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.510455] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.510695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.510793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.511061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.511247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.511418] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.511590] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.619260] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 956.619558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.806757] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.806872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-367" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.806967] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-367" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.808034] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-367" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.808034] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.808034] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.808034] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.808378] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.808585] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.808867] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 956.809062] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.809237] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.809404] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.809599] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 956.809794] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.810148] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 956.812348] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 in Status: SUCCESS [ 956.812689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.815171] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.815362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.815749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.816063] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.816231] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.816947] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be updated. [ 956.839962] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 956.840175] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 956.840414] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 956.840957] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-367" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.841239] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-209796ca-7c0c-4f4c-9542-1781a85ceb8e taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.841452] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-209796ca-7c0c-4f4c-9542-1781a85ceb8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.843466] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-209796ca-7c0c-4f4c-9542-1781a85ceb8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.843466] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-209796ca-7c0c-4f4c-9542-1781a85ceb8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.843466] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('209796ca-7c0c-4f4c-9542-1781a85ceb8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.860979] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.861182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.861222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.864938] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.864938] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.876894] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: IN_PROGRESS for 2s [ 956.880569] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.882031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.882031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.882031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.882031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.882031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.882031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.882031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.882393] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.882393] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.882486] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e already deleted. [ 956.882603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.896411] env[69491]: INFO networking_nsxv3.common.synchronization [req-fd464bb4-29e2-4f2b-8bdb-a428b973f32a req-97592e0d-7643-4357-a844-8b9af5af3677 tempest-ListServerFiltersTestJSON-114866394 tempest-ListServerFiltersTestJSON-114866394-project-member] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 956.897070] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 956.897399] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.897526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.897597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.897799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.897956] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.899134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.899262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.899508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.900753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.900753] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.979136] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 956.979697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.981192] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 789463b7-5fc9-4430-a16f-f50c87169e3f in Status: SUCCESS [ 956.981192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.981843] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: SUCCESS [ 956.982033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.982197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.982419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.982612] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.984383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.984383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.984383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.984383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.984383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.984678] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.985718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.985718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.985839] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.985915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.985947] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.987144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.987144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.987144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.987144] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('789463b7-5fc9-4430-a16f-f50c87169e3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.990246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.990678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.990678] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.990796] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.990796] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.990935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.991025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.991111] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.991869] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.992344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.992527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.992744] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.992847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.992910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.996024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.996024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.996024] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.996024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.996024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.996024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.996024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.996024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.996024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.996024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.996024] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('789463b7-5fc9-4430-a16f-f50c87169e3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.996024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.996024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.996024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.996886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.996886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.996886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.996886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.996886] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.015401] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d394eeb6-7de4-4a71-8d79-c137cc55ad50: rpc.has_security_group_logging(os_id): False [ 957.036494] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.036757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.036757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.036911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.037012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.037228] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.037328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.037393] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.037552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.037629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.037811] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.037933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.038036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.038153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.038227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.038418] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.038511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.038583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.038779] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.038891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.038934] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be created. [ 957.135192] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.135541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.135541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.135702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.135807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.153349] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 957.346666] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.346861] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.347349] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.347349] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.348504] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.348504] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 209796ca-7c0c-4f4c-9542-1781a85ceb8e not found, creating... [ 957.348504] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.348504] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.348504] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.348504] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.348504] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.349243] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.349243] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.349243] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.349615] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.349615] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.349615] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 209796ca-7c0c-4f4c-9542-1781a85ceb8e is going to be created. [ 957.372586] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.372586] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.372936] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.373018] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.373244] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.373491] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-209796ca-7c0c-4f4c-9542-1781a85ceb8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.404074] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.494896] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.495082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.495366] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('789463b7-5fc9-4430-a16f-f50c87169e3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.501312] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.501312] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.501312] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.501312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.501476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.501861] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.501861] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.501963] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.502087] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.502156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.502321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.502396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.502483] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 is going to be updated. [ 957.503863] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.503863] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.503863] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.504016] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.504148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.504335] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.504440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.504504] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.504656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.504734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.505094] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 789463b7-5fc9-4430-a16f-f50c87169e3f is going to be deleted. [ 957.541616] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.542024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.542024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.542333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.546027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.546027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.546027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.546027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.546027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.546027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.546027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.559929] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: IN_PROGRESS for 2s [ 957.906161] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.000258] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 789463b7-5fc9-4430-a16f-f50c87169e3f: rpc.has_security_group_logging(os_id): False [ 958.001424] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 491f4d82-845e-4e02-b3d7-2b5c77772eb6: rpc.has_security_group_logging(os_id): False [ 958.002345] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.024054] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.024209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.024280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.024497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.024584] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.024866] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.024929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.024960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.025135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.025208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.025297] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789463b7-5fc9-4430-a16f-f50c87169e3f is going to be created. [ 958.028637] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.028710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.028794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.028991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.029094] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.029357] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.029464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.029589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.029726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.029832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.029987] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 is going to be updated. [ 958.055328] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/789463b7-5fc9-4430-a16f-f50c87169e3f], does not exist path=[/infra/domains/default/groups/789463b7-5fc9-4430-a16f-f50c87169e3f]."\n}' [ 958.055490] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789463b7-5fc9-4430-a16f-f50c87169e3f failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/789463b7-5fc9-4430-a16f-f50c87169e3f [ 958.055840] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 958.121146] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.121353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.121445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.121677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.121829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.134862] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.135059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.135112] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.135356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.136474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.136810] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.136934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.136997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.137201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.137280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.137558] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.137694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.137750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.137919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.137991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.138220] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789463b7-5fc9-4430-a16f-f50c87169e3f is going to be created. [ 958.144786] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.144970] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.145087] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.145368] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.145716] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.146020] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.147911] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.148275] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.148498] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.148756] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.148885] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.149030] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.149150] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.149278] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.149399] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.149546] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.156823] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: IN_PROGRESS for 2s [ 958.162569] env[69491]: INFO networking_nsxv3.common.synchronization [req-da5720f5-49cf-459e-969d-5d0b2a4493aa req-c77a081f-5590-4fd8-9862-4431a8412325 service nova] Enqueued Resource ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e with Priority: HIGHEST for action security_group_rules [ 958.162569] env[69491]: INFO networking_nsxv3.common.synchronization [req-da5720f5-49cf-459e-969d-5d0b2a4493aa req-c77a081f-5590-4fd8-9862-4431a8412325 service nova] Enqueued Resource ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e with Priority: HIGHEST for action security_group_members [ 958.162569] env[69491]: INFO networking_nsxv3.common.synchronization [req-da5720f5-49cf-459e-969d-5d0b2a4493aa req-c77a081f-5590-4fd8-9862-4431a8412325 service nova] Enqueued Resource ID: 209796ca-7c0c-4f4c-9542-1781a85ceb8e with Priority: HIGHEST for action port [ 958.170016] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e with Priority: HIGHEST for action security_group_rules [ 958.170016] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e with Priority: HIGHEST for action security_group_members [ 958.170352] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 209796ca-7c0c-4f4c-9542-1781a85ceb8e with Priority: HIGHEST for action port [ 958.171200] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21ffc58d-ad1f-4978-9447-c2859da9a03e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.171422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.171725] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.173096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.173096] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21ffc58d-ad1f-4978-9447-c2859da9a03e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.174829] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-21ffc58d-ad1f-4978-9447-c2859da9a03e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.174829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.174829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.174829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.174829] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.175213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.175213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.175499] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.175651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.175922] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21ffc58d-ad1f-4978-9447-c2859da9a03e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.178156] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-209796ca-7c0c-4f4c-9542-1781a85ceb8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.178396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-209796ca-7c0c-4f4c-9542-1781a85ceb8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.178504] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-209796ca-7c0c-4f4c-9542-1781a85ceb8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.180074] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-209796ca-7c0c-4f4c-9542-1781a85ceb8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.180244] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('209796ca-7c0c-4f4c-9542-1781a85ceb8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.205014] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/789463b7-5fc9-4430-a16f-f50c87169e3f], does not exist path=[/infra/domains/default/groups/789463b7-5fc9-4430-a16f-f50c87169e3f]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/789463b7-5fc9-4430-a16f-f50c87169e3f [ 958.205259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-789463b7-5fc9-4430-a16f-f50c87169e3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.205514] env[69491]: Traceback (most recent call last): [ 958.205600] env[69491]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 958.205600] env[69491]: return func(*args, **kwargs) [ 958.205600] env[69491]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 958.205600] env[69491]: res.raise_for_status() [ 958.205600] env[69491]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 958.205600] env[69491]: raise HTTPError(http_error_msg, response=self) [ 958.205600] env[69491]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/789463b7-5fc9-4430-a16f-f50c87169e3f [ 958.205852] env[69491]: During handling of the above exception, another exception occurred: [ 958.205852] env[69491]: Traceback (most recent call last): [ 958.205852] env[69491]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 958.205852] env[69491]: listener.cb(fileno) [ 958.205852] env[69491]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 958.205852] env[69491]: result = function(*args, **kwargs) [ 958.205852] env[69491]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 958.205852] env[69491]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 958.205852] env[69491]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 958.205852] env[69491]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 958.205852] env[69491]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 958.205852] env[69491]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 958.205852] env[69491]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 958.205852] env[69491]: res.raise_for_status() [ 958.205852] env[69491]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 958.205852] env[69491]: raise HTTPError(http_error_msg, response=self) [ 958.205852] env[69491]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/789463b7-5fc9-4430-a16f-f50c87169e3f [ 958.205852] env[69491]: Removing descriptor: 23 [ 958.219774] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.220203] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.070 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 958.220374] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.220631] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.221646] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-8cdbb56f-d764-4414-b7b2-24a3601c6d59 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.222048] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-8cdbb56f-d764-4414-b7b2-24a3601c6d59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.222181] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-8cdbb56f-d764-4414-b7b2-24a3601c6d59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.222604] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-8cdbb56f-d764-4414-b7b2-24a3601c6d59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.222861] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cdbb56f-d764-4414-b7b2-24a3601c6d59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.409655] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.409832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.409874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.410082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.410175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.410277] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a783226f-a1df-4921-a642-6c211f5f8022 is going to be updated. [ 958.441273] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.441463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.441502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.441682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.441829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.452832] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: IN_PROGRESS for 2s [ 958.506282] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.506476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.506514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.507139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.507289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.507437] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 958.566207] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.566620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.566620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.567050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.567210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.577943] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 958.682458] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21ffc58d-ad1f-4978-9447-c2859da9a03e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.683412] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-21ffc58d-ad1f-4978-9447-c2859da9a03e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.683524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.686195] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 209796ca-7c0c-4f4c-9542-1781a85ceb8e with status ACTIVE [ 958.686453] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.686617] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.686690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.686907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.686997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.687223] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.687324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.687390] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.687557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.687636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.687820] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.687917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.687991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.688142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.688217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.688302] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 209796ca-7c0c-4f4c-9542-1781a85ceb8e is going to be updated. [ 958.711070] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.711259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.711299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.711495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.711635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.711802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-209796ca-7c0c-4f4c-9542-1781a85ceb8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.728956] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.729223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.729357] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.729716] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.729807] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.729954] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 8cdbb56f-d764-4414-b7b2-24a3601c6d59 not found, creating... [ 958.730284] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.730494] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.730606] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.730857] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.730998] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.731303] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.731466] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.731588] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.731801] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.732012] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.736218] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 8cdbb56f-d764-4414-b7b2-24a3601c6d59 is going to be created. [ 958.757798] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.758067] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.758214] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.758510] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.758747] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.758977] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-8cdbb56f-d764-4414-b7b2-24a3601c6d59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.887163] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 958.887389] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.168210] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 959.168453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.184989] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21ffc58d-ad1f-4978-9447-c2859da9a03e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.568122] env[69491]: INFO networking_nsxv3.common.synchronization [req-7e4987ff-6d3a-4712-b37f-a61d14a71874 req-a6e771b0-2017-409c-b614-45475398a2f9 service nova] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_rules [ 959.571052] env[69491]: INFO networking_nsxv3.common.synchronization [req-7e4987ff-6d3a-4712-b37f-a61d14a71874 req-a6e771b0-2017-409c-b614-45475398a2f9 service nova] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 959.571644] env[69491]: INFO networking_nsxv3.common.synchronization [req-7e4987ff-6d3a-4712-b37f-a61d14a71874 req-a6e771b0-2017-409c-b614-45475398a2f9 service nova] Enqueued Resource ID: 8cdbb56f-d764-4414-b7b2-24a3601c6d59 with Priority: HIGHEST for action port [ 959.571778] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_rules [ 959.571938] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 959.572061] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cdbb56f-d764-4414-b7b2-24a3601c6d59 with Priority: HIGHEST for action port [ 959.572791] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.572922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.572994] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.573205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.573285] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.574535] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.574666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.574736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.575434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.575660] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.575761] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.575830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.575991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.576117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.576206] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.577456] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cdbb56f-d764-4414-b7b2-24a3601c6d59 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.577572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cdbb56f-d764-4414-b7b2-24a3601c6d59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.577613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cdbb56f-d764-4414-b7b2-24a3601c6d59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.581839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cdbb56f-d764-4414-b7b2-24a3601c6d59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.581839] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cdbb56f-d764-4414-b7b2-24a3601c6d59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.581839] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: SUCCESS [ 959.581839] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 deletion is rescheduled due to dependency. [ 959.581839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.689392] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.689392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.689392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.689656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.689768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.689861] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e is going to be created. [ 959.716095] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.716230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.716295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.717180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.717180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.727596] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e in Status: UNINITIALIZED for 2s [ 960.064019] env[69491]: INFO networking_nsxv3.common.synchronization [req-8e476a9b-fa43-4095-94a1-8666fb132d76 req-a0619d4a-3a05-4ffb-b99f-b5598c72784d tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGHEST for action security_group_members [ 960.064393] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGHEST for action security_group_members [ 960.065109] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d029d7dd-2e40-4077-9e65-c77ae878eeb1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.065109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.065109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.072773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.072773] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.072773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.072773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.072773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.072773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.072773] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d029d7dd-2e40-4077-9e65-c77ae878eeb1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.082250] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.083133] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8cdbb56f-d764-4414-b7b2-24a3601c6d59 with status ACTIVE [ 960.083420] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.083566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.083649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.083883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.083963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.084122] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.084227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.084290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.084472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.084535] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.084683] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.084778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.084838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.085039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.085724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.085850] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8cdbb56f-d764-4414-b7b2-24a3601c6d59 is going to be updated. [ 960.088762] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.088872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.114091] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.114308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.114308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.114411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.114557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.114728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cdbb56f-d764-4414-b7b2-24a3601c6d59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.198023] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 in Status: SUCCESS [ 960.198023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.219449] env[69491]: INFO networking_nsxv3.common.synchronization [None req-64e25bc7-6206-40d7-a2f9-f3cfd9331370 None None] Enqueued Resource ID: 936ba606-4ef2-4570-8891-9b9142b1accc with Priority: HIGHEST for action port [ 960.220104] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936ba606-4ef2-4570-8891-9b9142b1accc with Priority: HIGHEST for action port [ 960.220715] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-936ba606-4ef2-4570-8891-9b9142b1accc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.220715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-936ba606-4ef2-4570-8891-9b9142b1accc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.220715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-936ba606-4ef2-4570-8891-9b9142b1accc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.222238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-936ba606-4ef2-4570-8891-9b9142b1accc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.222238] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('936ba606-4ef2-4570-8891-9b9142b1accc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.463970] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: SUCCESS [ 960.463970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.519197] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-348 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.519422] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.519422] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.519657] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.520390] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.521233] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.521451] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.522131] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.522358] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.522625] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.522757] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.522877] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.522994] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.523122] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.523236] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.523372] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.545878] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.546143] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.546340] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.546638] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.547016] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-ad911770-ecc1-4b17-9a53-ac55586a15e1 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.547248] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-ad911770-ecc1-4b17-9a53-ac55586a15e1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.547329] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-ad911770-ecc1-4b17-9a53-ac55586a15e1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.547706] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-ad911770-ecc1-4b17-9a53-ac55586a15e1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.547792] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad911770-ecc1-4b17-9a53-ac55586a15e1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.574130] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.574609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.574609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.574609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.576028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.576028] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.576028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.576028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.576028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.576028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.576028] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 already deleted. [ 960.576028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.589384] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 960.590834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.590834] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.591760] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.592713] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.593124] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.593250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.593250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.593448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.593534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.593675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.593841] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.593943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.594050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.594223] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.594366] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.594461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.594534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.594766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.594826] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.595316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.595432] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.725244] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 936ba606-4ef2-4570-8891-9b9142b1accc [ 960.725945] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.725945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.725945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.726307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.726307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.726497] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:936ba606-4ef2-4570-8891-9b9142b1accc already deleted. [ 960.726497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-936ba606-4ef2-4570-8891-9b9142b1accc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.858587] env[69491]: INFO networking_nsxv3.common.synchronization [req-a6d1d6f2-4fcf-41c1-a85b-7f45887ccbed req-10b2f72c-153c-43b0-bfb7-bdb056f1f907 tempest-ServerDiskConfigTestJSON-964931906 tempest-ServerDiskConfigTestJSON-964931906-project-member] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 960.858587] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 960.858587] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.860847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.860847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.860847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.860847] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.860847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.860847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.860847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.860847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.860847] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.058895] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.058895] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.058895] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.058895] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.059103] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.059212] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port ad911770-ecc1-4b17-9a53-ac55586a15e1 not found, creating... [ 961.059476] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.062872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.062872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.062872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.062872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.062872] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.062872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.062872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.062872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.062872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.062872] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: ad911770-ecc1-4b17-9a53-ac55586a15e1 is going to be created. [ 961.089339] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.089698] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.089900] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.090383] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.092140] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.092140] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-ad911770-ecc1-4b17-9a53-ac55586a15e1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.097517] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.097751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.097861] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.098331] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.098468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.098617] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be updated. [ 961.100358] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaa139e8-f09f-4a46-897a-d481019a63be: rpc.has_security_group_logging(os_id): False [ 961.121526] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.124199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.124199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.124199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.147985] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.147985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.147985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.147985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.147985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.152180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.152603] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.152771] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.152869] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.153200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.153373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.153700] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.153858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.153965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.154805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.154805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.154805] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.154805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.155105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.155152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.155247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.155365] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 961.167843] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: IN_PROGRESS for 2s [ 961.295340] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.295546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.295546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.295913] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.296186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.327472] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 961.365097] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.365291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.365334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.365558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.405267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.409489] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.409646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.409646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.409874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.410021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.410021] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 961.459787] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.459931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.460038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.460231] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.460372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.475589] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 961.745848] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e in Status: SUCCESS [ 961.745848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.745848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.746475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.746692] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.746898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.746987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.747202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.747556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.747556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.747556] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21ffc58d-ad1f-4978-9447-c2859da9a03e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.803073] env[69491]: INFO networking_nsxv3.common.synchronization [req-8e476a9b-fa43-4095-94a1-8666fb132d76 req-b9ba641c-c21a-48d3-90eb-56a91a98d5fc service nova] Enqueued Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGHEST for action security_group_rules [ 961.803781] env[69491]: INFO networking_nsxv3.common.synchronization [req-8e476a9b-fa43-4095-94a1-8666fb132d76 req-b9ba641c-c21a-48d3-90eb-56a91a98d5fc service nova] Enqueued Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGHEST for action security_group_members [ 961.804071] env[69491]: INFO networking_nsxv3.common.synchronization [req-8e476a9b-fa43-4095-94a1-8666fb132d76 req-b9ba641c-c21a-48d3-90eb-56a91a98d5fc service nova] Enqueued Resource ID: ad911770-ecc1-4b17-9a53-ac55586a15e1 with Priority: HIGHEST for action port [ 961.805218] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGHEST for action security_group_rules [ 961.805502] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGHEST for action security_group_members [ 961.805642] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad911770-ecc1-4b17-9a53-ac55586a15e1 with Priority: HIGHEST for action port [ 961.806029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.806232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.806386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.806616] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.806774] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d029d7dd-2e40-4077-9e65-c77ae878eeb1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.808589] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d029d7dd-2e40-4077-9e65-c77ae878eeb1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.808981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.809794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.810133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.810349] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.810441] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.810504] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.810664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.810835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.810835] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d029d7dd-2e40-4077-9e65-c77ae878eeb1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.811782] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad911770-ecc1-4b17-9a53-ac55586a15e1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.811893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad911770-ecc1-4b17-9a53-ac55586a15e1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.811942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad911770-ecc1-4b17-9a53-ac55586a15e1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.812118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad911770-ecc1-4b17-9a53-ac55586a15e1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.812215] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad911770-ecc1-4b17-9a53-ac55586a15e1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.250835] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-21ffc58d-ad1f-4978-9447-c2859da9a03e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.251064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.251158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.251484] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.251781] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.252064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.252205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.252373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.252465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.252996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.252996] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-21ffc58d-ad1f-4978-9447-c2859da9a03e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.252996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.252996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.253278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.253332] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.253446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.253597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.253850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.253850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.254026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.254370] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21ffc58d-ad1f-4978-9447-c2859da9a03e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.319969] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d029d7dd-2e40-4077-9e65-c77ae878eeb1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.320385] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d029d7dd-2e40-4077-9e65-c77ae878eeb1 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.320385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.320723] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad911770-ecc1-4b17-9a53-ac55586a15e1 with status ACTIVE [ 962.320904] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.321422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.321422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.321704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.321755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.321918] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.325134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.325134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.326428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.326428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.326428] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.326428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.326428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.326428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.326428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.326428] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad911770-ecc1-4b17-9a53-ac55586a15e1 is going to be updated. [ 962.358663] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.358851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.358851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.360524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.360524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.360524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad911770-ecc1-4b17-9a53-ac55586a15e1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.368395] env[69491]: INFO networking_nsxv3.common.synchronization [req-d9941d8a-4339-45e9-800c-257b5820e863 req-8673262f-94bf-44c6-a911-3d8d5144bf31 tempest-ImagesNegativeTestJSON-2071510463 tempest-ImagesNegativeTestJSON-2071510463-project-member] Enqueued Resource ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 with Priority: HIGHEST for action security_group_members [ 962.369267] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 with Priority: HIGHEST for action security_group_members [ 962.369603] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a17d719d-b50f-4937-8fa1-f7b3109414a1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.369961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.370060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.370249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.370423] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.370513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.370585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.370736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.370971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.370971] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a17d719d-b50f-4937-8fa1-f7b3109414a1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.759876] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21ffc58d-ad1f-4978-9447-c2859da9a03e: rpc.has_security_group_logging(os_id): False [ 962.781413] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.781413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.781413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.781413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.781413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.781413] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.781413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.781413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.781413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.781413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.781413] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.781413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.781413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.782416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.783620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.785156] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.785156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.785156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.785156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.785156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.785156] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e is going to be created. [ 962.817249] env[69491]: INFO networking_nsxv3.common.synchronization [None req-b94042e8-3347-453a-838d-81bc8548a147 None None] Enqueued Resource ID: c8699552-91cb-4195-a20a-b2487000b1f6 with Priority: HIGHEST for action port [ 962.817249] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8699552-91cb-4195-a20a-b2487000b1f6 with Priority: HIGHEST for action port [ 962.817249] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8699552-91cb-4195-a20a-b2487000b1f6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.819087] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8699552-91cb-4195-a20a-b2487000b1f6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.819369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8699552-91cb-4195-a20a-b2487000b1f6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.819885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8699552-91cb-4195-a20a-b2487000b1f6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.820138] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8699552-91cb-4195-a20a-b2487000b1f6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.830071] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d029d7dd-2e40-4077-9e65-c77ae878eeb1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.867221] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.867221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.867221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.867221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.867221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.873615] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.873879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.874032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.874165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.887721] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e in Status: IN_PROGRESS for 2s [ 962.898844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.899155] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.899277] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.899355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.899551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.899631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.900667] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 is going to be updated. [ 962.955415] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.955697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.955697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.956155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.956380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.971600] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 in Status: IN_PROGRESS for 2s [ 963.157483] env[69491]: INFO networking_nsxv3.common.synchronization [None req-49764836-406d-498a-85ac-b23f2dae2b25 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_rules [ 963.157483] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_rules [ 963.157971] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.157971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.157971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.159737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.159737] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.185120] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 963.185369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.185894] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.186120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.186318] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.186437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.186501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.186656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.186868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.186868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.186941] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.269183] env[69491]: INFO networking_nsxv3.common.synchronization [None req-fad0494f-26b8-4c7a-8236-69c7b3b30750 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_rules [ 963.270012] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_rules [ 963.270431] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.270567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.325114] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8699552-91cb-4195-a20a-b2487000b1f6 [ 963.325114] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.325114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.325114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.325114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.325114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.325114] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8699552-91cb-4195-a20a-b2487000b1f6 already deleted. [ 963.325114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8699552-91cb-4195-a20a-b2487000b1f6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.335386] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.335386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.335386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.335386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.335386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.335386] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 is going to be created. [ 963.355529] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 963.355529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.373244] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.373526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.373526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.373801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.374035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.388311] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 in Status: UNINITIALIZED for 2s [ 963.487981] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 963.488189] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff deletion is rescheduled due to dependency. [ 963.488350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.686358] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.686358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.686358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.686358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.686358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.686678] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc already deleted. [ 963.686678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.686678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.686859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.686943] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.693384] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.693384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.693384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.693384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.693384] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.693384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.693384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.693384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.693384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.693384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.693384] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.693384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.693384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.693384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.693384] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.693384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.693953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.693953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.693953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.693953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.693953] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.196372] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9632268c-db1a-4548-9652-b638bc84b886: rpc.has_security_group_logging(os_id): False [ 964.223777] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.223777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.223777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.223777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.223777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.223777] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc already deleted. [ 964.223777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.243612] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.243612] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.244315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.244628] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.283241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.283503] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.283646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.283706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.284048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.284161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.284340] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.284439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.284502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.284650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.284729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.284948] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.285075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.285129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.285318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.285318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.285386] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be updated. [ 964.357815] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.357987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.358082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.358347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.358502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.375053] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: IN_PROGRESS for 2s [ 964.899389] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e in Status: SUCCESS [ 964.899649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.985780] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 in Status: SUCCESS [ 964.985780] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 deletion is rescheduled due to dependency. [ 964.985780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.990131] env[69491]: INFO networking_nsxv3.common.synchronization [req-2506d2d1-be42-412d-84ed-b74cb66d8be3 req-d1dd8b04-45ff-40ad-83eb-7aa0c3372348 tempest-VolumesAdminNegativeTest-1366311223 tempest-VolumesAdminNegativeTest-1366311223-project-member] Enqueued Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGHEST for action security_group_members [ 964.990131] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGHEST for action security_group_members [ 964.990131] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4084412-2aca-4bc0-a15c-1690668e51ea taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.990131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.990131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.990131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.990131] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.990131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.990131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.990131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.990131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.990625] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.402287] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 in Status: SUCCESS [ 965.402287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.402287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.402287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.402287] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.402287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.402287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.402287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.402287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.402287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.402287] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d029d7dd-2e40-4077-9e65-c77ae878eeb1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.493081] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.493485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.493485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.493660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.516378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.516694] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.516798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.517135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.517508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.517508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.517621] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4084412-2aca-4bc0-a15c-1690668e51ea is going to be updated. [ 965.555012] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.555515] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.555610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.556078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.556254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.568299] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4084412-2aca-4bc0-a15c-1690668e51ea in Status: IN_PROGRESS for 2s [ 965.902312] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d029d7dd-2e40-4077-9e65-c77ae878eeb1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.394402] env[69491]: INFO networking_nsxv3.common.synchronization [req-13c4d45e-a640-4952-a57f-e5ec071d8b9c req-1d4e976b-44a8-4424-94cb-0ef0a9cd7b50 tempest-ServerActionsTestOtherB-761111206 tempest-ServerActionsTestOtherB-761111206-project-member] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 966.395527] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 966.395740] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.396990] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 966.397330] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.397455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.397523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.397734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.397889] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.397989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.398065] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.398221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.398324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.398476] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.405072] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d029d7dd-2e40-4077-9e65-c77ae878eeb1: rpc.has_security_group_logging(os_id): False [ 966.425420] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.425591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.425663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.425903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.426246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.426324] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.426414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.426480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.426648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.426741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.426833] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 is going to be created. [ 966.503021] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.503021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.503021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.503021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.503021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.515654] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 in Status: IN_PROGRESS for 2s [ 966.804214] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.804408] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.804537] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.804835] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.805738] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.806391] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.806391] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.806556] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.806892] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.807049] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.807201] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.807405] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.807486] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.807646] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.807763] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.807953] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.839882] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.840285] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 966.840612] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.840941] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.841507] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.841748] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.841900] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.842267] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.842419] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.902026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.902155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.902208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.902411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.933276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.933276] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.933276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.933276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.933276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.933554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.933554] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 966.963212] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.963376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.963413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.963603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.963751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.974165] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 967.345703] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.345984] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.346243] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.346596] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.346761] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.346928] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0 not found, creating... [ 967.347223] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.347398] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.347523] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.347762] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.347904] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.350995] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.351284] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.351475] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.351785] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.351997] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.352240] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0 is going to be created. [ 967.377179] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.377508] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.377788] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.378170] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.378484] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.378785] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.580820] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4084412-2aca-4bc0-a15c-1690668e51ea in Status: SUCCESS [ 967.581241] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4084412-2aca-4bc0-a15c-1690668e51ea deletion is rescheduled due to dependency. [ 967.581241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.111172] env[69491]: INFO networking_nsxv3.common.synchronization [req-13c4d45e-a640-4952-a57f-e5ec071d8b9c req-efbba160-8fbb-4b33-a760-c9b362da955a service nova] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_rules [ 968.112725] env[69491]: INFO networking_nsxv3.common.synchronization [req-13c4d45e-a640-4952-a57f-e5ec071d8b9c req-efbba160-8fbb-4b33-a760-c9b362da955a service nova] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 968.113179] env[69491]: INFO networking_nsxv3.common.synchronization [req-13c4d45e-a640-4952-a57f-e5ec071d8b9c req-efbba160-8fbb-4b33-a760-c9b362da955a service nova] Enqueued Resource ID: de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0 with Priority: HIGHEST for action port [ 968.113940] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_rules [ 968.115902] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 968.115902] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0 with Priority: HIGHEST for action port [ 968.115902] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.115902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.115902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.115902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.115902] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.119492] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.119492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.119492] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.119492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.119492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.119492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.119492] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.531247] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 in Status: SUCCESS [ 968.531514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.618327] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.618610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.622048] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0 with status ACTIVE [ 968.622287] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.622427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.622498] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.622732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.622827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.623016] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.623227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.623227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.623411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.623561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.623764] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.623915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.624029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.624387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.624387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.624526] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0 is going to be updated. [ 968.649923] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.650089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.650201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.650387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.650546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.650709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de3e65ea-7c20-40c1-b4e3-d8dd1bf759b0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.984273] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 968.984450] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 deletion is rescheduled due to dependency. [ 968.984571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.984786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.985073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.985252] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.985416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.985498] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.985657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.985879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.985879] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.316099] env[69491]: INFO networking_nsxv3.common.synchronization [req-4799b2f7-0562-4fcd-adb7-13997b5783f3 req-a5e3dbfe-40f3-4ed1-9155-3b5ea9dc0f69 tempest-ServersTestBootFromVolume-1969005607 tempest-ServersTestBootFromVolume-1969005607-project-member] Enqueued Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGHEST for action security_group_members [ 969.316663] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGHEST for action security_group_members [ 969.316990] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4976ed-85d7-4836-b6cb-a96b2293c655 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.317309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.317309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.317395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.317544] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.317825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.317896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.318110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.318207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.318300] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.488513] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.820941] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.821353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.821353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.821610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.848151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.848622] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.848770] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.848839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.849176] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.849340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.849449] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de4976ed-85d7-4836-b6cb-a96b2293c655 is going to be updated. [ 969.888963] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.889237] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.889322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.889646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.889872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.904192] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4976ed-85d7-4836-b6cb-a96b2293c655 in Status: IN_PROGRESS for 2s [ 969.990845] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.286268] env[69491]: INFO networking_nsxv3.common.synchronization [req-a5ed2981-0fda-4fc5-8bb0-914ba3d06ad4 req-5b84befb-05d0-41f1-8e8b-e264c8e2fffb tempest-ImagesTestJSON-1178517317 tempest-ImagesTestJSON-1178517317-project-member] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 970.286940] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 970.287607] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.287997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.288294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.288719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.289193] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.290995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.290995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.290995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.290995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.290995] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.495914] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.495914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.495914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.496082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.496399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.496399] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 970.533310] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.533310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.534041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.534041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.534041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.547712] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 970.684064] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.684316] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.684451] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.684746] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.685274] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.685459] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.685608] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.685878] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.686048] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.686385] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.686558] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 970.686724] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 970.686919] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 970.687125] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.687330] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 970.687509] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 970.711032] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 970.711273] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 970.711489] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 970.711713] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.712218] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-1067c148-b22a-401b-8698-35660395c910 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.712741] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-1067c148-b22a-401b-8698-35660395c910" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.712741] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-1067c148-b22a-401b-8698-35660395c910" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.713811] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-1067c148-b22a-401b-8698-35660395c910" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.713811] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1067c148-b22a-401b-8698-35660395c910',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.793233] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.217437] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.217437] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.217437] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.217912] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.217912] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.217912] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 1067c148-b22a-401b-8698-35660395c910 not found, creating... [ 971.218306] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.218417] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.218544] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.218773] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.218922] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.219435] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.219622] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.219843] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.222681] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.222681] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.222681] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 1067c148-b22a-401b-8698-35660395c910 is going to be created. [ 971.248072] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.248374] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.249148] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.249148] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.249148] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.249342] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-1067c148-b22a-401b-8698-35660395c910" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.295571] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.800707] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.800707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.800707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.800707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.800707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.800707] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 971.845980] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.845980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.845980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.845980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.845980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.863785] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 971.917922] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4976ed-85d7-4836-b6cb-a96b2293c655 in Status: SUCCESS [ 971.917922] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de4976ed-85d7-4836-b6cb-a96b2293c655 deletion is rescheduled due to dependency. [ 971.917922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.504917] env[69491]: INFO networking_nsxv3.common.synchronization [req-a5ed2981-0fda-4fc5-8bb0-914ba3d06ad4 req-d0e76171-4efc-4400-80aa-430da04626a6 service nova] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_rules [ 972.505229] env[69491]: INFO networking_nsxv3.common.synchronization [req-a5ed2981-0fda-4fc5-8bb0-914ba3d06ad4 req-d0e76171-4efc-4400-80aa-430da04626a6 service nova] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 972.505310] env[69491]: INFO networking_nsxv3.common.synchronization [req-a5ed2981-0fda-4fc5-8bb0-914ba3d06ad4 req-d0e76171-4efc-4400-80aa-430da04626a6 service nova] Enqueued Resource ID: 1067c148-b22a-401b-8698-35660395c910 with Priority: HIGHEST for action port [ 972.505834] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_rules [ 972.505972] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 972.507591] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1067c148-b22a-401b-8698-35660395c910 with Priority: HIGHEST for action port [ 972.508038] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.508241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.508319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.510484] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.510613] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.516123] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.516123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.516123] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-1067c148-b22a-401b-8698-35660395c910 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.516123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1067c148-b22a-401b-8698-35660395c910" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.516123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1067c148-b22a-401b-8698-35660395c910" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.516123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1067c148-b22a-401b-8698-35660395c910" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.516123] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1067c148-b22a-401b-8698-35660395c910',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.562192] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 972.562192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.562430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.563073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.563073] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.563073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.563073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.563073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.563350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.563350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.563350] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.017346] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1067c148-b22a-401b-8698-35660395c910 with status ACTIVE [ 973.020500] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.020500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.020500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.020500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.020500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.020500] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.020500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.020500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.020500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.020500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.020500] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.020500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.020500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.020500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.020500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.020500] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1067c148-b22a-401b-8698-35660395c910 is going to be updated. [ 973.022137] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.022137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.051129] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.051211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.051262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.053043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.053043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.053043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1067c148-b22a-401b-8698-35660395c910" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.065951] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.083910] env[69491]: INFO networking_nsxv3.common.synchronization [req-9eabee03-e2af-4775-bbed-4fbd661167ea req-a670ef72-8e1d-4062-b369-117e090913d6 tempest-ServerRescueTestJSON-1463555039 tempest-ServerRescueTestJSON-1463555039-project-member] Enqueued Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_members [ 973.085065] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_members [ 973.085065] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.086103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.086103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.086103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.086103] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.086596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.086596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.086596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.086596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.086712] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.477663] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-824 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.478027] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-824" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.478103] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-824" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.478414] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-824" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.478692] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.478861] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.478984] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.481052] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.481052] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.481052] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.481052] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.481052] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.481570] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.481897] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.482262] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.482502] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.514751] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.515043] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 973.515233] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.515534] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-824" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.515961] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-c96ac5b6-f5fc-4533-8cab-12ec09f547e0 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.516361] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-c96ac5b6-f5fc-4533-8cab-12ec09f547e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.516501] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-c96ac5b6-f5fc-4533-8cab-12ec09f547e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.517023] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-c96ac5b6-f5fc-4533-8cab-12ec09f547e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.517237] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c96ac5b6-f5fc-4533-8cab-12ec09f547e0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.573246] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fd20800-5a4b-495c-a02a-35b10f00ea55: rpc.has_security_group_logging(os_id): False [ 973.589550] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.590019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.590019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.590272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.590414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.590959] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.590959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.590959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.591174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.591206] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.591313] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab already deleted. [ 973.591400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.595473] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.595473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.595643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.595879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.596026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.596381] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.596491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.596543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.596700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.596783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.596900] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 973.674727] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.674932] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.675089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.677047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.677271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.696179] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 973.876957] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 973.876957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.876957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.876957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.876957] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.876957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.876957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.876957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.876957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.877798] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.020075] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.020436] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.020712] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.021067] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.021289] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.021544] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port c96ac5b6-f5fc-4533-8cab-12ec09f547e0 not found, creating... [ 974.022016] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.022321] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.022471] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.022842] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.023015] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.023723] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.024024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.024158] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.024525] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.024677] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.024926] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: c96ac5b6-f5fc-4533-8cab-12ec09f547e0 is going to be created. [ 974.050823] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.051093] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.051234] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.051528] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.055124] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.055124] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-c96ac5b6-f5fc-4533-8cab-12ec09f547e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.379506] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.429223] env[69491]: INFO networking_nsxv3.common.synchronization [req-fbca8753-45e5-4fc3-9c1b-a59e3db3461b req-7195dc3b-d382-48e9-99ff-6c8f4c6e22cc tempest-AttachInterfacesV270Test-1761351879 tempest-AttachInterfacesV270Test-1761351879-project-member] Enqueued Resource ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e with Priority: HIGHEST for action security_group_members [ 974.429861] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e with Priority: HIGHEST for action security_group_members [ 974.430540] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-21ffc58d-ad1f-4978-9447-c2859da9a03e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.430540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.430540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.430733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.430733] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.430949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.430949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.431167] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.431167] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.431284] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21ffc58d-ad1f-4978-9447-c2859da9a03e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.589478] env[69491]: INFO networking_nsxv3.common.synchronization [req-88fde4c0-b926-48c7-b5ac-ffd2aead1914 req-629dd11b-ff2d-4e61-90a7-f378df65a3af tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 974.590508] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 974.590912] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.591088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.591200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.591589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.591771] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.592179] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.592179] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.592306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.592419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.592586] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.784553] env[69491]: INFO networking_nsxv3.common.synchronization [req-407fd113-c2d2-4439-a558-85f086d406ea req-fc015a08-4a84-4b58-ae77-318187105a76 tempest-ServersWithSpecificFlavorTestJSON-938071933 tempest-ServersWithSpecificFlavorTestJSON-938071933-project-member] Enqueued Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_members [ 974.784553] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGHEST for action security_group_members [ 974.784553] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.784553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.784553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.785038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.785148] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.785381] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.785467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.785695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.785827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.785939] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.881903] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.934099] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.934099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.934099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.934099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.934328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.934422] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.934526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.934589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.934755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.934836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.934912] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e is going to be updated. [ 975.015564] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.015564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.015564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.015564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.015564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.028484] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e in Status: IN_PROGRESS for 2s [ 975.094300] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.163494] env[69491]: INFO networking_nsxv3.common.synchronization [req-9eabee03-e2af-4775-bbed-4fbd661167ea req-bd6e33bd-010a-4ea0-aac3-d042d82e3120 service nova] Enqueued Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_rules [ 975.163936] env[69491]: INFO networking_nsxv3.common.synchronization [req-9eabee03-e2af-4775-bbed-4fbd661167ea req-bd6e33bd-010a-4ea0-aac3-d042d82e3120 service nova] Enqueued Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_members [ 975.163936] env[69491]: INFO networking_nsxv3.common.synchronization [req-9eabee03-e2af-4775-bbed-4fbd661167ea req-bd6e33bd-010a-4ea0-aac3-d042d82e3120 service nova] Enqueued Resource ID: c96ac5b6-f5fc-4533-8cab-12ec09f547e0 with Priority: HIGHEST for action port [ 975.164430] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_rules [ 975.164573] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_members [ 975.164672] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c96ac5b6-f5fc-4533-8cab-12ec09f547e0 with Priority: HIGHEST for action port [ 975.164993] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.169854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.169854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.169854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.169854] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.173048] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.173048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.173048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.173048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.173048] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.173048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.173048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.173048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.173048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.173048] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.173048] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-c96ac5b6-f5fc-4533-8cab-12ec09f547e0 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.173566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c96ac5b6-f5fc-4533-8cab-12ec09f547e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.173566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c96ac5b6-f5fc-4533-8cab-12ec09f547e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.173566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c96ac5b6-f5fc-4533-8cab-12ec09f547e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.173566] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c96ac5b6-f5fc-4533-8cab-12ec09f547e0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.289062] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.290342] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.290495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.291080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.320414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.320754] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.320875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.320875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.321266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.321266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.321266] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53902bde-30e4-44b3-9472-853fecdeacca is going to be updated. [ 975.356110] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.356280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.356369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.356600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.356776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.368031] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: IN_PROGRESS for 2s [ 975.384854] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.386278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.386278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.386278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.386278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.386278] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 975.417046] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.417239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.417306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.417525] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.417666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.433382] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 975.600706] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.675570] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.675800] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.676009] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.677034] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c96ac5b6-f5fc-4533-8cab-12ec09f547e0 with status ACTIVE [ 975.677185] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.677356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.677595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.677710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.677710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.677900] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.677997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.678077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.678222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.678295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.678499] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.678603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.678658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.678786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.678849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.679128] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c96ac5b6-f5fc-4533-8cab-12ec09f547e0 is going to be updated. [ 975.701678] env[69491]: INFO networking_nsxv3.common.synchronization [req-93e6c264-1f14-476d-acb5-4d40ff71f3fd req-8f469d2a-c0d6-4507-ba98-b3df2c912434 tempest-MigrationsAdminTest-1576792364 tempest-MigrationsAdminTest-1576792364-project-member] Enqueued Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_members [ 975.702246] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_members [ 975.704668] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.704668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.704668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.706448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.706448] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.706448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.706448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.706448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.706448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.706448] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.715818] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.715818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.715818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.715818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.715818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.715818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c96ac5b6-f5fc-4533-8cab-12ec09f547e0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.721643] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 975.721643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.034674] env[69491]: INFO networking_nsxv3.common.synchronization [None req-fa04584d-1937-4a3b-9620-45db73b1cae6 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 976.035351] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 976.036109] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.036259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.102736] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.102897] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.102971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.103945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.103945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.103945] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be updated. [ 976.139813] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.140091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.142486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.142486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.142486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.153141] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: IN_PROGRESS for 2s [ 976.182937] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.208653] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.245090] env[69491]: INFO networking_nsxv3.common.synchronization [req-a544f967-f138-4c3b-b2cc-aae9d9129e3a req-5796430a-6236-42b8-aeb6-01f858697bab tempest-ServersAdminTestJSON-362478418 tempest-ServersAdminTestJSON-362478418-project-member] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 976.245606] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 976.245822] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.245948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.246117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.247191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.250265] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.250448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.250538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.250732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.250858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.250924] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.686492] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.686843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.686843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.686954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.687058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.687162] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab is going to be created. [ 976.713659] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.719792] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.719792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.719792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.719792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.719792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.731162] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: UNINITIALIZED for 2s [ 976.757151] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.040569] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e in Status: SUCCESS [ 977.040774] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e deletion is rescheduled due to dependency. [ 977.040887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.220842] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.221019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.221109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.221316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.221406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.221506] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57178755-8937-4ec8-907c-6e349b3947d2 is going to be updated. [ 977.258395] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.263487] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.263595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.263668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.263894] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.264082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.275613] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: IN_PROGRESS for 2s [ 977.381782] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53902bde-30e4-44b3-9472-853fecdeacca in Status: SUCCESS [ 977.382106] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53902bde-30e4-44b3-9472-853fecdeacca deletion is rescheduled due to dependency. [ 977.382154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.445851] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 977.446565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.447979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.447979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.447979] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.448651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.448651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.449037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.449343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.449485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.450111] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.599391] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.599834] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.600066] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.600504] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.600863] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.601212] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.601339] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.601713] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.601967] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.602213] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.602350] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.602519] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.602648] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.602794] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.602934] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.603150] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.631633] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.632634] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 977.632887] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.633962] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-834" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.634794] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-1fd5a7a2-3365-4476-8ce0-4a73c1638d19 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.635113] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-1fd5a7a2-3365-4476-8ce0-4a73c1638d19" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.635307] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-1fd5a7a2-3365-4476-8ce0-4a73c1638d19" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.636289] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-1fd5a7a2-3365-4476-8ce0-4a73c1638d19" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.636555] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fd5a7a2-3365-4476-8ce0-4a73c1638d19',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.766041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.766041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.766041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.766041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.766041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.766041] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 977.816578] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.816796] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.816911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.817162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.817323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.830867] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 977.866308] env[69491]: INFO networking_nsxv3.common.synchronization [None req-c20ed303-df9d-4de6-8b32-79795d1a0d1c None None] Enqueued Resource ID: 74cd71e2-8e29-4dd2-b70f-0ccc2196c9fb with Priority: HIGHEST for action port [ 977.868929] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74cd71e2-8e29-4dd2-b70f-0ccc2196c9fb with Priority: HIGHEST for action port [ 977.868929] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-74cd71e2-8e29-4dd2-b70f-0ccc2196c9fb taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.868929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74cd71e2-8e29-4dd2-b70f-0ccc2196c9fb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.868929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74cd71e2-8e29-4dd2-b70f-0ccc2196c9fb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.868929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74cd71e2-8e29-4dd2-b70f-0ccc2196c9fb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.868929] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74cd71e2-8e29-4dd2-b70f-0ccc2196c9fb',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.956026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.956026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.956026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.956026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.956026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.956026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.956026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.956026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.956026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.956026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.956026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.956026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.956026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.956026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.957796] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.958158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.958272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.958472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.958568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.958670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.958777] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.139555] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.139841] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.140052] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.140444] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.140646] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.140882] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 1fd5a7a2-3365-4476-8ce0-4a73c1638d19 not found, creating... [ 978.141268] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.141488] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.141647] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.141951] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.142188] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.142719] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.142856] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.143025] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.143375] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.143587] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.143791] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 1fd5a7a2-3365-4476-8ce0-4a73c1638d19 is going to be created. [ 978.163786] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 978.164082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.164278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.164566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.164840] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.164992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.165128] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.165311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.165412] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.165524] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.171934] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.171934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.171934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.171934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.171934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.171934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-1fd5a7a2-3365-4476-8ce0-4a73c1638d19" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.372024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74cd71e2-8e29-4dd2-b70f-0ccc2196c9fb [ 978.372024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.372024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.372024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.372024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.372024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.372024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74cd71e2-8e29-4dd2-b70f-0ccc2196c9fb already deleted. [ 978.372024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74cd71e2-8e29-4dd2-b70f-0ccc2196c9fb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.461675] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9028d23d-9b03-48da-a060-d720486e9412: rpc.has_security_group_logging(os_id): False [ 978.483666] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.483859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.483859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.484156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.511123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.511123] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.511123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.511123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.511123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.511123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.511123] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.511123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.511123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.511569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.511569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.511569] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.511569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.511697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.512216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.512216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.512216] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 978.593253] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.593480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.593614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.594599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.594599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.613730] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 978.673918] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.674159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.674265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.674508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.674622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.674835] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.674936] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.675017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.675192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.675291] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.675351] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be updated. [ 978.736630] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.736630] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.736630] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.736921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.737138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.742763] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: SUCCESS [ 978.743395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.743395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.743855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.743855] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.744562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.744562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.744562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.744562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.744562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.745182] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.752465] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: IN_PROGRESS for 2s [ 979.006995] env[69491]: INFO networking_nsxv3.common.synchronization [req-a544f967-f138-4c3b-b2cc-aae9d9129e3a req-41d71b47-5c67-47ed-83bc-42c5ecdd6b2f service nova] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_rules [ 979.007261] env[69491]: INFO networking_nsxv3.common.synchronization [req-a544f967-f138-4c3b-b2cc-aae9d9129e3a req-41d71b47-5c67-47ed-83bc-42c5ecdd6b2f service nova] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 979.007341] env[69491]: INFO networking_nsxv3.common.synchronization [req-a544f967-f138-4c3b-b2cc-aae9d9129e3a req-41d71b47-5c67-47ed-83bc-42c5ecdd6b2f service nova] Enqueued Resource ID: 1fd5a7a2-3365-4476-8ce0-4a73c1638d19 with Priority: HIGHEST for action port [ 979.007905] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_rules [ 979.008536] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 979.008699] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fd5a7a2-3365-4476-8ce0-4a73c1638d19 with Priority: HIGHEST for action port [ 979.009687] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.009839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.009887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.010281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.010281] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.011634] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.011734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.011939] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fd5a7a2-3365-4476-8ce0-4a73c1638d19 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.012049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fd5a7a2-3365-4476-8ce0-4a73c1638d19" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.012116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fd5a7a2-3365-4476-8ce0-4a73c1638d19" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.012694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fd5a7a2-3365-4476-8ce0-4a73c1638d19" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.012812] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fd5a7a2-3365-4476-8ce0-4a73c1638d19',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.243198] env[69491]: INFO networking_nsxv3.common.synchronization [req-77d011eb-24f5-42a8-9d5b-ad20c0a22464 req-8bc61b33-813e-4779-8556-3aaa367bbc98 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGHEST for action security_group_members [ 979.244306] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGHEST for action security_group_members [ 979.244306] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.244306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.244518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.244611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.244912] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.244912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.245215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.245215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.245215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.246076] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab8f0b03-5851-4bc3-a9e8-aba2b5714126',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.251296] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.251296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.251296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.251296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.251296] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.251296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.251296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.251296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.251296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.251296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.251296] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.251296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.251296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.251296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.251296] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.251296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.251888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.251888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.251888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.251888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.251888] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.292673] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: SUCCESS [ 979.292952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.512567] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.512764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.515128] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1fd5a7a2-3365-4476-8ce0-4a73c1638d19 with status ACTIVE [ 979.515347] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.515566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.515655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.515853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.515940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.516131] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.516237] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.516289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.516526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.516635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.516796] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.516891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.516954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.517125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.517711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.517711] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1fd5a7a2-3365-4476-8ce0-4a73c1638d19 is going to be updated. [ 979.544627] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.544792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.545151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.545230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.545411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.545694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fd5a7a2-3365-4476-8ce0-4a73c1638d19" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.750975] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.751174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.751248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.752316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.755809] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d226f0cc-ed68-4bbb-a45f-f167f2ea29ab: rpc.has_security_group_logging(os_id): False [ 979.781635] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.781635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.785620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.786049] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.786596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.786711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.786945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.787067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.787146] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 is going to be updated. [ 979.788547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.788815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.788906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.789207] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.789330] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.789396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.789569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.789628] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.789888] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.790010] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.790096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.790282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.790377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.790580] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.790678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.790742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.790910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.791446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.791446] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab is going to be created. [ 979.840294] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.840513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.840639] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.841023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.841368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.845741] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 979.846069] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.846337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.846936] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.847049] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.847299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.847452] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.847731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.847893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.848341] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.856176] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 in Status: IN_PROGRESS for 2s [ 979.888984] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.888984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.888984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.888984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.888984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.908582] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: IN_PROGRESS for 2s [ 980.351198] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.578567] env[69491]: INFO networking_nsxv3.common.synchronization [None req-457127d4-b2c5-4912-aaae-d34ea6a0130d None None] Enqueued Resource ID: 805d3b59-4cdc-47fd-923c-0d7d08a2d84b with Priority: HIGHEST for action port [ 980.579243] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 805d3b59-4cdc-47fd-923c-0d7d08a2d84b with Priority: HIGHEST for action port [ 980.579571] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-805d3b59-4cdc-47fd-923c-0d7d08a2d84b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.579723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-805d3b59-4cdc-47fd-923c-0d7d08a2d84b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.579815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-805d3b59-4cdc-47fd-923c-0d7d08a2d84b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.580094] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-805d3b59-4cdc-47fd-923c-0d7d08a2d84b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.580185] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('805d3b59-4cdc-47fd-923c-0d7d08a2d84b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.635122] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 980.635122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.766114] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 980.766266] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 deletion is rescheduled due to dependency. [ 980.766362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.853402] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.082063] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 805d3b59-4cdc-47fd-923c-0d7d08a2d84b [ 981.082354] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.082522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.082595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.082823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.082911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.083024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:805d3b59-4cdc-47fd-923c-0d7d08a2d84b already deleted. [ 981.083113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-805d3b59-4cdc-47fd-923c-0d7d08a2d84b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.356116] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.356613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.356613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.356613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.357201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.357201] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 981.388973] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.388973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.388973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.388973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.388973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.398257] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 981.867650] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 in Status: SUCCESS [ 981.867887] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 deletion is rescheduled due to dependency. [ 981.867964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.920502] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: SUCCESS [ 981.920742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.002124] env[69491]: INFO networking_nsxv3.common.synchronization [req-6c66aad2-8d34-4c48-87e4-b8615f9d9563 req-4329b90d-8d57-49ba-9ed5-29d45e91f9dc tempest-ServersTestManualDisk-1552727568 tempest-ServersTestManualDisk-1552727568-project-member] Enqueued Resource ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f with Priority: HIGHEST for action security_group_members [ 982.002690] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f with Priority: HIGHEST for action security_group_members [ 982.003015] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.003146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.003213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.003411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.003574] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.003677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.003742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.003887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.003972] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.005034] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.510440] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.510440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.510440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.510440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.531497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.531622] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.531771] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.531883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.532151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.532233] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.532324] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f is going to be updated. [ 982.564803] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.564961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.565081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.565321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.565495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.579684] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f in Status: IN_PROGRESS for 2s [ 983.411401] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 983.411401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.411653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.412168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.412377] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.412540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.412669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.412772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.412867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.412961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.413267] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.916338] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.916834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.916834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.916910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.917082] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.917325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.917325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.917433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.917487] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.917577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.917740] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.917832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.917893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.918083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.919560] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.919560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.919560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.919560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.919560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.919560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.919560] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.423504] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebfca2b7-f089-437e-979a-24f210590561: rpc.has_security_group_logging(os_id): False [ 984.447104] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.447297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.447297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.447620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.478210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.478671] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.478893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.480032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.480032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.480167] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.480312] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.480421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.480474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.481058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.481058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.481058] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.481058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.481373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.481373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.481373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.481528] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 984.583598] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.583598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.583598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.584058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.584125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.601931] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f in Status: SUCCESS [ 984.601931] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f deletion is rescheduled due to dependency. [ 984.601931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.606784] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 985.155030] env[69491]: INFO networking_nsxv3.common.synchronization [req-d1aa15aa-8812-456c-af05-329fb53f194b req-bf904cf6-f88e-40f4-ba24-73e5e881577e tempest-ListServerFiltersTestJSON-114866394 tempest-ListServerFiltersTestJSON-114866394-project-member] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 985.155030] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 985.155030] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.155030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.155030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.155030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.155030] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.155030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.155030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.155030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.155030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.155030] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.657467] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.051259] env[69491]: INFO networking_nsxv3.common.synchronization [req-e535b9a5-786f-4220-8a6f-7f9de4526ca2 req-a0df457d-6f8e-4569-8595-3a209cf4577f tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_members [ 986.051578] env[69491]: INFO networking_nsxv3.common.synchronization [req-e535b9a5-786f-4220-8a6f-7f9de4526ca2 req-a0df457d-6f8e-4569-8595-3a209cf4577f tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 with Priority: HIGHEST for action security_group_members [ 986.051813] env[69491]: INFO networking_nsxv3.common.synchronization [req-e535b9a5-786f-4220-8a6f-7f9de4526ca2 req-a0df457d-6f8e-4569-8595-3a209cf4577f tempest-SecurityGroupsTestJSON-373010668 tempest-SecurityGroupsTestJSON-373010668-project-member] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 986.052525] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGHEST for action security_group_members [ 986.052669] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 with Priority: HIGHEST for action security_group_members [ 986.052792] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGHEST for action security_group_members [ 986.053180] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.053334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.053506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.053614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.053774] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.053883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.053949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.054132] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.054218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.054335] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.055348] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f7c8116-1800-43a9-8bbf-52caccb697c1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.055478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.055550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.055822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.056105] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.056219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.056327] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.056548] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.056704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.056846] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f7c8116-1800-43a9-8bbf-52caccb697c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.057671] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.057783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.057853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.058009] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.058155] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.058249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.058308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.058445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.058520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.058645] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.160199] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.564230] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.565592] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.565592] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.565937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.570348] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.570348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.570348] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.570348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.588839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.589135] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.589284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.589318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.589522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.589592] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.589684] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 is going to be updated. [ 986.590972] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.591177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.615138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.615138] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.615138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.615138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.615138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.615138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.615138] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf is going to be updated. [ 986.616385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.616669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.616824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.617075] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.617201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.617245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.617407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.617478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.617566] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be updated. [ 986.620770] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.620897] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.620965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.622066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.622066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.624312] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 986.624507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.632213] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 in Status: IN_PROGRESS for 2s [ 986.657175] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.657175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.657175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.657347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.657446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.659293] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.659432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.659504] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.659643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.659758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.662593] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.662593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.662593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.662875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.662875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.663395] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a783226f-a1df-4921-a642-6c211f5f8022 is going to be updated. [ 986.669891] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: IN_PROGRESS for 2s [ 986.670589] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: IN_PROGRESS for 2s [ 986.696722] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.696926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.697009] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.697232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.697374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.710068] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: IN_PROGRESS for 2s [ 986.809900] env[69491]: INFO networking_nsxv3.common.synchronization [req-f0b83501-155e-446f-be8b-e021f7c3fccd req-9ed69809-b164-4b72-afdf-9a53cd5d487e tempest-ServerDiskConfigTestJSON-964931906 tempest-ServerDiskConfigTestJSON-964931906-project-member] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 986.810564] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 986.810892] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.814393] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.814674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.814977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.815216] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.815334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.815406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.815562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.815650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.815759] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.320202] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.320202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.320202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.320202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.320202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.320202] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.320202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.320202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.320202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.320202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.320202] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 987.347469] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.347638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.347702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.347926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.348117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.357826] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 987.437543] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-956 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.437761] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.437761] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.438117] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.438408] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.438579] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.438701] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.438934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.439092] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.439435] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.439435] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.439550] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.439668] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.439783] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.439896] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.440058] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.462399] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.462399] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 987.462399] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.462399] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.462399] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-f93e942d-d5df-4d9c-94d0-a837a944624f taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.462399] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-f93e942d-d5df-4d9c-94d0-a837a944624f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.462399] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-f93e942d-d5df-4d9c-94d0-a837a944624f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.462802] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-f93e942d-d5df-4d9c-94d0-a837a944624f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.462802] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f93e942d-d5df-4d9c-94d0-a837a944624f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.967024] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.967024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.967024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.967024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.967024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.967024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port f93e942d-d5df-4d9c-94d0-a837a944624f not found, creating... [ 987.967024] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.967024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.967024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.967024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.967574] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.967574] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.967649] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.967723] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.967947] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.968135] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.968285] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: f93e942d-d5df-4d9c-94d0-a837a944624f is going to be created. [ 987.989715] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.989941] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.990089] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.990378] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.990609] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.990877] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-f93e942d-d5df-4d9c-94d0-a837a944624f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.643678] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 in Status: SUCCESS [ 988.643929] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 deletion is rescheduled due to dependency. [ 988.644115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.688180] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf in Status: SUCCESS [ 988.688180] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf deletion is rescheduled due to dependency. [ 988.688180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.688180] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa139e8-f09f-4a46-897a-d481019a63be in Status: SUCCESS [ 988.688491] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa139e8-f09f-4a46-897a-d481019a63be deletion is rescheduled due to dependency. [ 988.688491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.720258] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: SUCCESS [ 988.720258] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.750248] env[69491]: INFO networking_nsxv3.common.synchronization [req-f0b83501-155e-446f-be8b-e021f7c3fccd req-4586fbb9-f834-4ab5-b53d-99c818caa918 service nova] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_rules [ 988.750387] env[69491]: INFO networking_nsxv3.common.synchronization [req-f0b83501-155e-446f-be8b-e021f7c3fccd req-4586fbb9-f834-4ab5-b53d-99c818caa918 service nova] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 988.750848] env[69491]: INFO networking_nsxv3.common.synchronization [req-f0b83501-155e-446f-be8b-e021f7c3fccd req-4586fbb9-f834-4ab5-b53d-99c818caa918 service nova] Enqueued Resource ID: f93e942d-d5df-4d9c-94d0-a837a944624f with Priority: HIGHEST for action port [ 988.751725] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_rules [ 988.751940] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 988.752170] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93e942d-d5df-4d9c-94d0-a837a944624f with Priority: HIGHEST for action port [ 988.752475] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.752632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.754439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.754439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.754439] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.755444] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.755559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.755808] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f93e942d-d5df-4d9c-94d0-a837a944624f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.755936] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f93e942d-d5df-4d9c-94d0-a837a944624f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.756078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f93e942d-d5df-4d9c-94d0-a837a944624f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.756274] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f93e942d-d5df-4d9c-94d0-a837a944624f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.756415] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f93e942d-d5df-4d9c-94d0-a837a944624f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.260254] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.260456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.260603] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f93e942d-d5df-4d9c-94d0-a837a944624f with status ACTIVE [ 989.260795] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.260894] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.260978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.261215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.261339] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.261491] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.261579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.261696] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.261785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.261837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.261997] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.262100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.262178] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.262309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.262389] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.262455] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f93e942d-d5df-4d9c-94d0-a837a944624f is going to be updated. [ 989.288551] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.288765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.288810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.289343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.289343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.289343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f93e942d-d5df-4d9c-94d0-a837a944624f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.371986] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 989.372280] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff deletion is rescheduled due to dependency. [ 989.372446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.372640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.372932] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.373211] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.373400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.373514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.373883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.374040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.374161] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.877508] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.381909] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.887042] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.887042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.887042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.887042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.887703] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.887965] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 990.933011] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.933420] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.933420] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.933531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.933666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.947714] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 992.964054] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 992.964371] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.965320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.965660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.965885] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.966028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.966095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.966296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.966382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.966482] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.966576] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.471070] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.471203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.471203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.471429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.471604] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.471704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.471771] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.471935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.472032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.472123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.472272] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.472401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.472471] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.472621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.472759] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.472852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.472968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.473140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.473252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.473347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.473435] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.753092] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 993.753344] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 993.979108] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab7773f0-7815-4a45-bf15-8a8079aa86ff: rpc.has_security_group_logging(os_id): False [ 994.003107] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.003900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.003900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.003900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.003900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.004376] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.005462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.005609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.005838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.005960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.006217] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.006447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.006531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.006721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.006821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.007100] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.007241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.007369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.007572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.007572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.009994] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 994.076435] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.076435] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.076615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.076787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.076851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.096305] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 994.402477] env[69491]: INFO networking_nsxv3.common.synchronization [req-9017c540-b426-484c-9cdf-f9220d4bf5a8 req-743209c8-5146-4a59-9009-de2452833103 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_members [ 994.403694] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_members [ 994.404061] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.404198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.404275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.404527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.404678] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.404772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.404886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.405068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.405107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.405185] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.773359] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.773359] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.773359] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.773359] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.777058] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.777058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.777058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.777058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.777058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.777058] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.777058] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.777405] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.777405] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.777405] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.777552] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.777725] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.799650] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.799650] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.799650] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.799650] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.799918] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-36a58e30-6604-438c-b6e7-8617237bc7e5 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.799918] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-36a58e30-6604-438c-b6e7-8617237bc7e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.800358] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-36a58e30-6604-438c-b6e7-8617237bc7e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.800358] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-36a58e30-6604-438c-b6e7-8617237bc7e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.800487] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36a58e30-6604-438c-b6e7-8617237bc7e5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.912591] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.912752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.912869] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.913067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.913158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.913361] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.913457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.913517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.913664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.913735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.913817] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc already deleted. [ 994.913895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.303283] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.303709] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.303709] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.304070] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.304296] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.304526] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 36a58e30-6604-438c-b6e7-8617237bc7e5 not found, creating... [ 995.304884] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.305093] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.305266] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.305558] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.305768] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.306788] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.307415] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.308114] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.309105] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.309579] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.310329] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 36a58e30-6604-438c-b6e7-8617237bc7e5 is going to be created. [ 995.333405] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.333564] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.333699] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.335594] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.335594] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.335594] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-36a58e30-6604-438c-b6e7-8617237bc7e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.082221] env[69491]: INFO networking_nsxv3.common.synchronization [req-9017c540-b426-484c-9cdf-f9220d4bf5a8 req-e30ce6d9-7031-4876-8e79-5ad7cdbdbd10 service nova] Enqueued Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_rules [ 996.082221] env[69491]: INFO networking_nsxv3.common.synchronization [req-9017c540-b426-484c-9cdf-f9220d4bf5a8 req-e30ce6d9-7031-4876-8e79-5ad7cdbdbd10 service nova] Enqueued Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_members [ 996.082221] env[69491]: INFO networking_nsxv3.common.synchronization [req-9017c540-b426-484c-9cdf-f9220d4bf5a8 req-e30ce6d9-7031-4876-8e79-5ad7cdbdbd10 service nova] Enqueued Resource ID: 36a58e30-6604-438c-b6e7-8617237bc7e5 with Priority: HIGHEST for action port [ 996.082221] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_rules [ 996.082221] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_members [ 996.082221] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36a58e30-6604-438c-b6e7-8617237bc7e5 with Priority: HIGHEST for action port [ 996.082706] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.082815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.082815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.084792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.085209] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.086390] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.086513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.086581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.086778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.087299] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.087299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.087299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.087299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.087471] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.087471] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.089081] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-36a58e30-6604-438c-b6e7-8617237bc7e5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.089081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36a58e30-6604-438c-b6e7-8617237bc7e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.089081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36a58e30-6604-438c-b6e7-8617237bc7e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.089323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36a58e30-6604-438c-b6e7-8617237bc7e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.089323] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36a58e30-6604-438c-b6e7-8617237bc7e5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.113113] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 996.113394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.587725] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.588075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.589462] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.591631] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36a58e30-6604-438c-b6e7-8617237bc7e5 with status ACTIVE [ 996.592142] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.592369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.592465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.593304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.593399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.593628] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.593740] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.593816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.596653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.597379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.597379] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.597379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.597379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.597379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.597613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.597613] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36a58e30-6604-438c-b6e7-8617237bc7e5 is going to be updated. [ 996.630374] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.630568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.630601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.630817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.630951] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.631140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36a58e30-6604-438c-b6e7-8617237bc7e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.764843] env[69491]: INFO networking_nsxv3.common.synchronization [req-28fa0e69-c6aa-4ea5-9c4f-dcace85c68a6 req-91ca3bb5-182b-4a80-83bd-e2baa768cf11 tempest-ImagesTestJSON-1178517317 tempest-ImagesTestJSON-1178517317-project-member] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 996.765217] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 996.765491] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.765614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.766126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.766126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.766813] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.767068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.767193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.767466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.767580] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.767834] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.092334] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.192311] env[69491]: INFO networking_nsxv3.common.synchronization [req-f55778f2-7825-4dcc-a6f6-6eddb2f34246 req-cc6c5aa4-4c16-426f-976a-415360ead9d1 tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 997.192987] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 997.193229] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.193354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.193417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.193620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.196225] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.196405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.196599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.196842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.197649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.197649] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.270484] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.600059] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.600059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.600059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.600059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.600059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.600059] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc is going to be created. [ 997.625952] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.626125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.626125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.626346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.626517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.636447] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: UNINITIALIZED for 2s [ 997.702019] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.773467] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.831077] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.831415] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.831624] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.833965] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.834384] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.834536] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.834668] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.835043] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.835111] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.835420] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.835542] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.835658] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.835769] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.835882] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.835991] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.836137] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.899905] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.900366] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.064 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 997.900678] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.901864] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.901864] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-59054426-4d88-4032-a052-6c08abe18449 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.901864] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-59054426-4d88-4032-a052-6c08abe18449" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.901864] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-59054426-4d88-4032-a052-6c08abe18449" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.902222] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-59054426-4d88-4032-a052-6c08abe18449" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.902420] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59054426-4d88-4032-a052-6c08abe18449',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.204056] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.275779] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.276739] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.276739] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.276739] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.276739] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.276739] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 998.316506] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.316804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.316939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.317382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.317632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.332412] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 998.405412] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.405741] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.405853] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.406205] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.406374] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.406557] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 59054426-4d88-4032-a052-6c08abe18449 not found, creating... [ 998.406959] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.407165] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.407345] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.407632] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.407787] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.408132] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.408496] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.408496] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.408719] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.408884] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.409062] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 59054426-4d88-4032-a052-6c08abe18449 is going to be created. [ 998.437028] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.437028] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.437028] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.437028] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.437028] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.437028] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-59054426-4d88-4032-a052-6c08abe18449" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.707798] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.708109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.708109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.708439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.708543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.708648] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 998.775031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.775031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.775031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.775031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.775031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.786536] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 999.368603] env[69491]: INFO networking_nsxv3.common.synchronization [req-f55778f2-7825-4dcc-a6f6-6eddb2f34246 req-c984f0df-43d5-4e8c-a2eb-82abe09164bb service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 999.368845] env[69491]: INFO networking_nsxv3.common.synchronization [req-f55778f2-7825-4dcc-a6f6-6eddb2f34246 req-c984f0df-43d5-4e8c-a2eb-82abe09164bb service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 999.368999] env[69491]: INFO networking_nsxv3.common.synchronization [req-f55778f2-7825-4dcc-a6f6-6eddb2f34246 req-c984f0df-43d5-4e8c-a2eb-82abe09164bb service nova] Enqueued Resource ID: 59054426-4d88-4032-a052-6c08abe18449 with Priority: HIGHEST for action port [ 999.369555] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 999.369707] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 999.369809] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59054426-4d88-4032-a052-6c08abe18449 with Priority: HIGHEST for action port [ 999.370785] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.370927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.371012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.371241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.371371] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.372266] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.372320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.372495] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-59054426-4d88-4032-a052-6c08abe18449 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.372600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59054426-4d88-4032-a052-6c08abe18449" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.372664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59054426-4d88-4032-a052-6c08abe18449" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.372840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59054426-4d88-4032-a052-6c08abe18449" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.372918] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59054426-4d88-4032-a052-6c08abe18449',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.647044] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: SUCCESS [ 999.647293] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.647474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.647702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.647890] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.648017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.648089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.648228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.648322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.648392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.648479] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.874938] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.875273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.875273] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59054426-4d88-4032-a052-6c08abe18449 with status ACTIVE [ 999.877099] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.877099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.877099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.877099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.877099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.877099] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.877099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.877099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.877099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.877099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.877099] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.877099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.877099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.877099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.877099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.877099] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59054426-4d88-4032-a052-6c08abe18449 is going to be updated. [ 999.903848] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.903848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.903848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.903848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.903848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.903848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59054426-4d88-4032-a052-6c08abe18449" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.150583] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.344360] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 1000.344688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.656242] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41c677ae-81d2-401f-823f-258d2ebc4afc: rpc.has_security_group_logging(os_id): False [ 1000.679248] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.679418] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.679527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.680112] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.680112] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.680326] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.680468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.680553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.680794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.680917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.681027] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc is going to be created. [ 1000.764903] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.765065] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.765140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.765396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.765585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.795536] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: IN_PROGRESS for 2s [ 1000.796836] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1000.797730] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.798978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.798978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.798978] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.798978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.798978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.798978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.798978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.799315] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.301968] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.804766] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.310029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.310029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.310029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.310029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.310029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.310029] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1002.343344] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.343495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.343570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.343781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.344937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.354538] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1002.811178] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: SUCCESS [ 1002.811416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.371066] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1004.371066] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1004.391757] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1004.393296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.395018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.395018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.395018] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.395018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.395018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.395018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.395018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.395018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.395018] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.587588] env[69491]: INFO networking_nsxv3.common.synchronization [None req-e278a14d-b91e-4227-8da6-4012cd251f26 None None] Enqueued Resource ID: 4620a171-b704-45a3-b852-8696e95d8536 with Priority: HIGHEST for action port [ 1004.588409] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620a171-b704-45a3-b852-8696e95d8536 with Priority: HIGHEST for action port [ 1004.589121] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-4620a171-b704-45a3-b852-8696e95d8536 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.589121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4620a171-b704-45a3-b852-8696e95d8536" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.589121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4620a171-b704-45a3-b852-8696e95d8536" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.592450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4620a171-b704-45a3-b852-8696e95d8536" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.592559] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4620a171-b704-45a3-b852-8696e95d8536',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.899889] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.899889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.899889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.900088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.900277] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.900277] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.900398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.900502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.900651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.900763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.900912] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.900996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.901073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.901218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.901347] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.901437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.901512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.901680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.901760] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.901839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.901925] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.097767] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4620a171-b704-45a3-b852-8696e95d8536 [ 1005.098024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.098139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.098997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.098997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.098997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.098997] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4620a171-b704-45a3-b852-8696e95d8536 already deleted. [ 1005.098997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4620a171-b704-45a3-b852-8696e95d8536" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.404125] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d394eeb6-7de4-4a71-8d79-c137cc55ad50: rpc.has_security_group_logging(os_id): False [ 1005.424723] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.424903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.424946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.426192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.448273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.448924] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.448924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.448924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.449098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.449098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.449399] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.449399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.449553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.450585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.450585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.450585] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.450585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.450585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.450585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.450585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.450585] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1005.530714] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.530714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.530714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.531047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.531047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.555678] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1005.781815] env[69491]: INFO networking_nsxv3.common.synchronization [None req-d5179f08-dec1-471d-aea0-04adde4adfbf None None] Enqueued Resource ID: d9b365b7-a587-4d6b-b135-7089fab52724 with Priority: HIGHEST for action port [ 1005.783595] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b365b7-a587-4d6b-b135-7089fab52724 with Priority: HIGHEST for action port [ 1005.785479] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9b365b7-a587-4d6b-b135-7089fab52724 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.785614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9b365b7-a587-4d6b-b135-7089fab52724" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.785707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9b365b7-a587-4d6b-b135-7089fab52724" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.786403] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9b365b7-a587-4d6b-b135-7089fab52724" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.786403] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9b365b7-a587-4d6b-b135-7089fab52724',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.293347] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9b365b7-a587-4d6b-b135-7089fab52724 [ 1006.293347] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.293347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.293347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.293347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.293347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.293347] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9b365b7-a587-4d6b-b135-7089fab52724 already deleted. [ 1006.293347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9b365b7-a587-4d6b-b135-7089fab52724" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.818594] env[69491]: INFO networking_nsxv3.common.synchronization [req-18c0607e-b982-4099-a033-a2ed11d20f65 req-21895b01-37db-4d3d-a25f-c6ccb2e328d4 tempest-MigrationsAdminTest-1576792364 tempest-MigrationsAdminTest-1576792364-project-member] Enqueued Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_members [ 1006.819221] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGHEST for action security_group_members [ 1006.819533] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.819690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.819752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.819902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.820290] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.820290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.820290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.820440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.820486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.820542] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.323464] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.323654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.323725] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.323933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.350065] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.350375] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.350518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.350518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.350939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.350939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.350939] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57178755-8937-4ec8-907c-6e349b3947d2 is going to be updated. [ 1007.395513] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.395513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.395513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.396342] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.396555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.409992] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: IN_PROGRESS for 2s [ 1007.554913] env[69491]: INFO networking_nsxv3.common.synchronization [None req-7e3bd3d1-a679-4d5c-a269-44a5180a6905 None None] Enqueued Resource ID: e75ac9e4-49c6-4d99-b12e-80488dde0602 with Priority: HIGHEST for action port [ 1007.565216] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e75ac9e4-49c6-4d99-b12e-80488dde0602 with Priority: HIGHEST for action port [ 1007.565658] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-e75ac9e4-49c6-4d99-b12e-80488dde0602 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.566123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e75ac9e4-49c6-4d99-b12e-80488dde0602" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.566123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e75ac9e4-49c6-4d99-b12e-80488dde0602" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.566298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e75ac9e4-49c6-4d99-b12e-80488dde0602" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.566298] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e75ac9e4-49c6-4d99-b12e-80488dde0602',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.584225] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1007.584531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.005332] env[69491]: INFO networking_nsxv3.common.synchronization [req-232cb210-3ca3-4491-986b-1e6c2f18142c req-e2abda85-a152-4d63-9303-7e80900d3a38 tempest-AttachVolumeTestJSON-1247015010 tempest-AttachVolumeTestJSON-1247015010-project-member] Enqueued Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGHEST for action security_group_members [ 1008.005332] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGHEST for action security_group_members [ 1008.005332] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-556224b2-1959-4315-89ac-879f1d706247 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.005332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.006478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.006989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.007310] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.007564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.008032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.008032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.008297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.009876] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('556224b2-1959-4315-89ac-879f1d706247',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.073413] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e75ac9e4-49c6-4d99-b12e-80488dde0602 [ 1008.076875] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.076875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.076875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.076875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.076875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.076875] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e75ac9e4-49c6-4d99-b12e-80488dde0602 already deleted. [ 1008.076875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e75ac9e4-49c6-4d99-b12e-80488dde0602" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.498513] env[69491]: INFO networking_nsxv3.common.synchronization [None req-903c18bf-c64c-4a7c-8d0a-80232251ded2 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_rules [ 1008.498513] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_rules [ 1008.498513] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.498513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.498513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.498513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.498513] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.511274] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.511435] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.511513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.511803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.537283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.537283] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.537283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.537283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.537283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.537283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.537283] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 556224b2-1959-4315-89ac-879f1d706247 is going to be updated. [ 1008.583137] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.583137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.583137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.583137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.583137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.597846] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 556224b2-1959-4315-89ac-879f1d706247 in Status: IN_PROGRESS for 2s [ 1008.792951] env[69491]: INFO networking_nsxv3.common.synchronization [None req-298917e6-ab2d-4d5b-8e52-12c39d376d44 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_rules [ 1008.792951] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_rules [ 1008.792951] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.792951] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.024480] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.025082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.025082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.025082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.025082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.025243] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 already deleted. [ 1009.025243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.025803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.026047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.026290] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.029147] env[69491]: INFO networking_nsxv3.common.synchronization [None req-b952cc57-5764-4645-805f-da75b49daee1 None None] Enqueued Resource ID: 882140b3-a7da-435d-a9a9-d184a486965d with Priority: HIGHEST for action port [ 1009.029768] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882140b3-a7da-435d-a9a9-d184a486965d with Priority: HIGHEST for action port [ 1009.030111] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-882140b3-a7da-435d-a9a9-d184a486965d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.030235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-882140b3-a7da-435d-a9a9-d184a486965d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.030304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-882140b3-a7da-435d-a9a9-d184a486965d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.030531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-882140b3-a7da-435d-a9a9-d184a486965d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.030610] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('882140b3-a7da-435d-a9a9-d184a486965d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.303753] env[69491]: INFO networking_nsxv3.common.synchronization [None req-887d11d1-b627-4dbc-8123-269ce37655a6 None None] Enqueued Resource ID: 29a94d31-799f-4dcb-b13b-93546962f697 with Priority: HIGHEST for action port [ 1009.304450] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a94d31-799f-4dcb-b13b-93546962f697 with Priority: HIGHEST for action port [ 1009.304649] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-29a94d31-799f-4dcb-b13b-93546962f697 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.304868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29a94d31-799f-4dcb-b13b-93546962f697" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.304868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29a94d31-799f-4dcb-b13b-93546962f697" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.306423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29a94d31-799f-4dcb-b13b-93546962f697" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.306423] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29a94d31-799f-4dcb-b13b-93546962f697',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.420533] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57178755-8937-4ec8-907c-6e349b3947d2 in Status: SUCCESS [ 1009.420533] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57178755-8937-4ec8-907c-6e349b3947d2 deletion is rescheduled due to dependency. [ 1009.420533] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.533070] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 882140b3-a7da-435d-a9a9-d184a486965d [ 1009.533841] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.534044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.534119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.534878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.535009] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.535118] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:882140b3-a7da-435d-a9a9-d184a486965d already deleted. [ 1009.535205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-882140b3-a7da-435d-a9a9-d184a486965d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.550565] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.550719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.550793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.551121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.551251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.551356] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 already deleted. [ 1009.551439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.809701] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29a94d31-799f-4dcb-b13b-93546962f697 [ 1009.811063] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.811063] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.811063] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.811726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.811850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.812098] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29a94d31-799f-4dcb-b13b-93546962f697 already deleted. [ 1009.812179] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29a94d31-799f-4dcb-b13b-93546962f697" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.611461] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 556224b2-1959-4315-89ac-879f1d706247 in Status: SUCCESS [ 1010.611461] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 556224b2-1959-4315-89ac-879f1d706247 deletion is rescheduled due to dependency. [ 1010.611461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.639331] env[69491]: INFO networking_nsxv3.common.synchronization [req-8b362b8d-1ee6-42e9-8007-07c8ff979a78 req-5dab673d-92f2-4263-9dea-1e2d58fbf32c tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1011.640383] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1011.640383] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.640571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.640571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.644108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.644108] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.644108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.644108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.644108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.644108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.644108] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.151734] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.317988] env[69491]: INFO networking_nsxv3.common.synchronization [req-7cbb02ed-cbd0-470d-a390-d66ea623fe91 req-429d99b1-8bb2-41ef-9e93-bf00ab820fb7 tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGHEST for action security_group_members [ 1012.317988] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGHEST for action security_group_members [ 1012.318093] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d029d7dd-2e40-4077-9e65-c77ae878eeb1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.318285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.318371] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.319617] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.319833] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.319951] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.320384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.320384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.320384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.320534] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d029d7dd-2e40-4077-9e65-c77ae878eeb1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.646611] env[69491]: INFO networking_nsxv3.common.synchronization [None req-42971ee7-7332-4968-9425-05bdcf3a94a9 None None] Enqueued Resource ID: de2058f9-eb90-4e2f-9c37-18b41bf0e9b3 with Priority: HIGHEST for action port [ 1012.646876] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2058f9-eb90-4e2f-9c37-18b41bf0e9b3 with Priority: HIGHEST for action port [ 1012.647126] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-de2058f9-eb90-4e2f-9c37-18b41bf0e9b3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.647615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de2058f9-eb90-4e2f-9c37-18b41bf0e9b3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.647615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de2058f9-eb90-4e2f-9c37-18b41bf0e9b3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.647615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de2058f9-eb90-4e2f-9c37-18b41bf0e9b3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.647725] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de2058f9-eb90-4e2f-9c37-18b41bf0e9b3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.654264] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.825010] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.825240] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.825310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.825590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.825779] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.825968] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.826192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.826192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.826322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.826407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.826466] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 is going to be updated. [ 1012.861425] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.861674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.861674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.861934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.862152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.874030] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 in Status: IN_PROGRESS for 2s [ 1013.155088] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de2058f9-eb90-4e2f-9c37-18b41bf0e9b3 [ 1013.155349] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.155481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.155537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.155811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.155946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.156103] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de2058f9-eb90-4e2f-9c37-18b41bf0e9b3 already deleted. [ 1013.156197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de2058f9-eb90-4e2f-9c37-18b41bf0e9b3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.156540] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.156651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.156714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.157159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.157265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.160926] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1013.198381] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.198602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.198662] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.199101] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.199101] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.217258] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1014.885258] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 in Status: SUCCESS [ 1014.885622] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 deletion is rescheduled due to dependency. [ 1014.885622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.231107] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1015.231845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.901449] env[69491]: INFO networking_nsxv3.common.synchronization [None req-e1111aaa-c08c-4364-a4ab-6d2a68c92337 None None] Enqueued Resource ID: 45bdc055-f424-478b-86f5-8b2add6f5d79 with Priority: HIGHEST for action port [ 1016.901730] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45bdc055-f424-478b-86f5-8b2add6f5d79 with Priority: HIGHEST for action port [ 1016.902322] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-45bdc055-f424-478b-86f5-8b2add6f5d79 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.902444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45bdc055-f424-478b-86f5-8b2add6f5d79" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.902524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45bdc055-f424-478b-86f5-8b2add6f5d79" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.902754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45bdc055-f424-478b-86f5-8b2add6f5d79" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.902832] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45bdc055-f424-478b-86f5-8b2add6f5d79',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.409932] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45bdc055-f424-478b-86f5-8b2add6f5d79 [ 1017.409932] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.410267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.410267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.410392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.410489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.410589] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45bdc055-f424-478b-86f5-8b2add6f5d79 already deleted. [ 1017.410667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45bdc055-f424-478b-86f5-8b2add6f5d79" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.045976] env[69491]: INFO networking_nsxv3.common.synchronization [req-796ce021-1caa-4b82-b540-6095534e3883 req-2a889278-d1c0-4382-b74e-65df03093c54 tempest-ListServerFiltersTestJSON-114866394 tempest-ListServerFiltersTestJSON-114866394-project-member] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 1018.048018] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGHEST for action security_group_members [ 1018.048018] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.048018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.048018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.048018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.048018] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.048018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.048018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.048018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.048018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.048018] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.551260] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.551466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.552425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.552425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.575481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.575788] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.575986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.576084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.576306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.576417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.576543] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a783226f-a1df-4921-a642-6c211f5f8022 is going to be updated. [ 1018.607902] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.607902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.607902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.607902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.607902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.617703] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: IN_PROGRESS for 2s [ 1019.232368] env[69491]: INFO networking_nsxv3.common.synchronization [None req-19416145-869c-4ea5-8362-b571b9a56bfa None None] Enqueued Resource ID: c1ff64ba-8d3b-47bb-9e9c-842638979a6d with Priority: HIGHEST for action port [ 1019.233016] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1ff64ba-8d3b-47bb-9e9c-842638979a6d with Priority: HIGHEST for action port [ 1019.233387] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1ff64ba-8d3b-47bb-9e9c-842638979a6d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.233535] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1ff64ba-8d3b-47bb-9e9c-842638979a6d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.233600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1ff64ba-8d3b-47bb-9e9c-842638979a6d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.233862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1ff64ba-8d3b-47bb-9e9c-842638979a6d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.233940] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1ff64ba-8d3b-47bb-9e9c-842638979a6d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.644689] env[69491]: INFO networking_nsxv3.common.synchronization [req-a7a5b9af-d265-4e15-9e9b-db8326905225 req-b65ddb9c-6e28-42bf-b725-c56860ba89d7 tempest-ServersAdminTestJSON-362478418 tempest-ServersAdminTestJSON-362478418-project-member] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 1019.644689] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 1019.644689] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.644689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.644689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.644689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.644689] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.644689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.644689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.644689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.644689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.644689] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.737150] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1ff64ba-8d3b-47bb-9e9c-842638979a6d [ 1019.737326] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.737462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.737532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.737742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.737829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.737930] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1ff64ba-8d3b-47bb-9e9c-842638979a6d already deleted. [ 1019.738017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1ff64ba-8d3b-47bb-9e9c-842638979a6d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.148321] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.633094] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a783226f-a1df-4921-a642-6c211f5f8022 in Status: SUCCESS [ 1020.633479] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a783226f-a1df-4921-a642-6c211f5f8022 deletion is rescheduled due to dependency. [ 1020.633479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.650243] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.153420] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.157182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.157182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.157182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.157182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.157182] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 1021.186301] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.186710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.186864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.187188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.187449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.199207] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 1023.212210] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 1023.212604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.295248] env[69491]: INFO networking_nsxv3.common.synchronization [req-833735d8-8977-4339-babf-17a2e0a6eced req-c96a64f9-3cf0-4854-8121-a21a7e897d9d tempest-ImagesTestJSON-1178517317 tempest-ImagesTestJSON-1178517317-project-member] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 1024.295847] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 1024.296200] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.296350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.296416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.297380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.297593] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.297813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.297885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.298083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.298154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.298250] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.802324] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.802324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.802324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.802324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.802324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.802857] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.802857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.802857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.802857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.802857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.803049] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 1024.833053] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.833218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.833290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.833501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.833646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.843694] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 1024.973842] env[69491]: INFO networking_nsxv3.common.synchronization [None req-4fc93076-0689-46fc-83f2-3bafd58dcf3b None None] Enqueued Resource ID: 6789faca-d536-48e2-933c-21eede4df7f3 with Priority: HIGHEST for action port [ 1024.974025] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6789faca-d536-48e2-933c-21eede4df7f3 with Priority: HIGHEST for action port [ 1024.974538] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-6789faca-d536-48e2-933c-21eede4df7f3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.974667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6789faca-d536-48e2-933c-21eede4df7f3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.974747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6789faca-d536-48e2-933c-21eede4df7f3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.974982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6789faca-d536-48e2-933c-21eede4df7f3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.975180] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6789faca-d536-48e2-933c-21eede4df7f3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.043673] env[69491]: INFO networking_nsxv3.common.synchronization [req-148bb2d0-e029-4ddd-866d-b705da4275e0 req-a08e048a-6ca2-4ea5-92ac-21d307c825f6 tempest-ServerRescueTestJSON-1463555039 tempest-ServerRescueTestJSON-1463555039-project-member] Enqueued Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_members [ 1025.044209] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_members [ 1025.044516] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.044642] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.044749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.044913] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.045083] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.045177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.045240] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.045383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.045493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.045591] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.479732] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6789faca-d536-48e2-933c-21eede4df7f3 [ 1025.480052] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.480134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.480187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.480400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.480494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.480592] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6789faca-d536-48e2-933c-21eede4df7f3 already deleted. [ 1025.480673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6789faca-d536-48e2-933c-21eede4df7f3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.547496] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.014334] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-824 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.014584] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-824" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.014744] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-824" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.015064] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-824" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.015384] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.015588] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.015729] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.015981] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.016301] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.016602] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.016803] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.017007] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.017296] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.017496] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.017703] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.017914] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.037680] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.037927] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1026.038840] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.039166] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-824" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.039798] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-1248e956-e9cd-40d4-b839-41c0f99f3f76 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.040060] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-1248e956-e9cd-40d4-b839-41c0f99f3f76" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.040248] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-1248e956-e9cd-40d4-b839-41c0f99f3f76" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.040606] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-1248e956-e9cd-40d4-b839-41c0f99f3f76" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.040802] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1248e956-e9cd-40d4-b839-41c0f99f3f76',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.056150] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.543984] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.544347] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.544425] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.544714] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.544882] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.545063] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 1248e956-e9cd-40d4-b839-41c0f99f3f76 not found, creating... [ 1026.545359] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.545525] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.545651] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.545904] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.546066] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.546386] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.546613] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.546703] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.546928] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.550832] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.551198] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 1248e956-e9cd-40d4-b839-41c0f99f3f76 is going to be created. [ 1026.555125] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.555282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.555334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.555542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.555635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.555735] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab is going to be updated. [ 1026.576761] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.577026] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.577154] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.577528] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.577795] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.578065] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-1248e956-e9cd-40d4-b839-41c0f99f3f76" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.589884] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.590116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.590116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.590333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.590482] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.602289] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: IN_PROGRESS for 2s [ 1026.854858] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 1026.855063] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 deletion is rescheduled due to dependency. [ 1026.855562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.030866] env[69491]: INFO networking_nsxv3.common.synchronization [None req-28263d74-6dc7-4256-8ea0-1a4ea798a047 None None] Enqueued Resource ID: 45199423-f292-44f0-964f-3b06da3a7729 with Priority: HIGHEST for action port [ 1027.030866] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45199423-f292-44f0-964f-3b06da3a7729 with Priority: HIGHEST for action port [ 1027.030866] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-45199423-f292-44f0-964f-3b06da3a7729 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.030866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45199423-f292-44f0-964f-3b06da3a7729" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.030866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45199423-f292-44f0-964f-3b06da3a7729" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.030866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45199423-f292-44f0-964f-3b06da3a7729" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.030866] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45199423-f292-44f0-964f-3b06da3a7729',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.534555] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45199423-f292-44f0-964f-3b06da3a7729 [ 1027.534555] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.534555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.534555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.534555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.534555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.534555] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45199423-f292-44f0-964f-3b06da3a7729 already deleted. [ 1027.534555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45199423-f292-44f0-964f-3b06da3a7729" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.553997] env[69491]: INFO networking_nsxv3.common.synchronization [req-148bb2d0-e029-4ddd-866d-b705da4275e0 req-0c6b2202-7f13-4ca6-9cc0-79c05810ca8a service nova] Enqueued Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_rules [ 1027.553997] env[69491]: INFO networking_nsxv3.common.synchronization [req-148bb2d0-e029-4ddd-866d-b705da4275e0 req-0c6b2202-7f13-4ca6-9cc0-79c05810ca8a service nova] Enqueued Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_members [ 1027.553997] env[69491]: INFO networking_nsxv3.common.synchronization [req-148bb2d0-e029-4ddd-866d-b705da4275e0 req-0c6b2202-7f13-4ca6-9cc0-79c05810ca8a service nova] Enqueued Resource ID: 1248e956-e9cd-40d4-b839-41c0f99f3f76 with Priority: HIGHEST for action port [ 1027.555081] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_rules [ 1027.555241] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_members [ 1027.555338] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1248e956-e9cd-40d4-b839-41c0f99f3f76 with Priority: HIGHEST for action port [ 1027.556284] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.556768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.557711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.557711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.557711] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.558252] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.558354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.558627] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-1248e956-e9cd-40d4-b839-41c0f99f3f76 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.558740] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1248e956-e9cd-40d4-b839-41c0f99f3f76" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.558806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1248e956-e9cd-40d4-b839-41c0f99f3f76" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.558986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1248e956-e9cd-40d4-b839-41c0f99f3f76" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.559076] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1248e956-e9cd-40d4-b839-41c0f99f3f76',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.060969] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.061232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.065542] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1248e956-e9cd-40d4-b839-41c0f99f3f76 with status ACTIVE [ 1028.066129] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.066129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.066129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.066497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.066497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.066497] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.066615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.066655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.066850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.066850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.067922] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.067922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.067922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.067922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.067922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.067922] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1248e956-e9cd-40d4-b839-41c0f99f3f76 is going to be updated. [ 1028.093798] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.093798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.093798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.093798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.093995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.094111] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1248e956-e9cd-40d4-b839-41c0f99f3f76" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.616727] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: SUCCESS [ 1028.617193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.617193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.617501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.617633] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.617729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.617796] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.618013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.618712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.618712] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.120412] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.631814] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.135022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.135022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.135022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.135022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.135022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.135022] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab is going to be updated. [ 1030.176712] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.176936] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.177060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.177377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.177623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.189033] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: IN_PROGRESS for 2s [ 1030.320958] env[69491]: INFO networking_nsxv3.common.synchronization [None req-e3478302-90ad-4884-96e4-4adff6c6f3b6 tempest-AttachVolumeTestJSON-1247015010 tempest-AttachVolumeTestJSON-1247015010-project-member] Enqueued Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGHEST for action security_group_rules [ 1030.321529] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGHEST for action security_group_rules [ 1030.321856] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-796dade6-def8-42b0-adbd-7347623ab0c8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.321989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.322068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.322476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.322569] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.633404] env[69491]: INFO networking_nsxv3.common.synchronization [None req-3bb9b56d-c5b1-4810-9505-a05a3db6085b tempest-AttachVolumeTestJSON-1247015010 tempest-AttachVolumeTestJSON-1247015010-project-member] Enqueued Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGHEST for action security_group_rules [ 1030.633978] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGHEST for action security_group_rules [ 1030.634270] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-796dade6-def8-42b0-adbd-7347623ab0c8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.634377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.850891] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.850891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.850891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.850891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.850891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.851233] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 796dade6-def8-42b0-adbd-7347623ab0c8 already deleted. [ 1030.851233] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.851388] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.853634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.853787] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.375780] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.375919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.376044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.376222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.379022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.379022] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 796dade6-def8-42b0-adbd-7347623ab0c8 already deleted. [ 1031.379022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.198624] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: SUCCESS [ 1032.199102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.199102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.199976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.199976] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.199976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.199976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.199976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.199976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.199976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.200288] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.321566] env[69491]: INFO networking_nsxv3.common.synchronization [None req-e84051a1-5fbc-43fc-8411-ba4c70acb8ad None None] Enqueued Resource ID: 568476d9-5d54-4140-a95b-b3115de0a46f with Priority: HIGHEST for action port [ 1032.321855] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568476d9-5d54-4140-a95b-b3115de0a46f with Priority: HIGHEST for action port [ 1032.322476] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-568476d9-5d54-4140-a95b-b3115de0a46f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.322607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-568476d9-5d54-4140-a95b-b3115de0a46f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.322671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-568476d9-5d54-4140-a95b-b3115de0a46f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.322937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-568476d9-5d54-4140-a95b-b3115de0a46f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.324599] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('568476d9-5d54-4140-a95b-b3115de0a46f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.704040] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.704040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.704040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.704040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.704040] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.704040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.704040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.705641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.705885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.706226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.708125] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.708125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.708125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.708125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.708125] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.708125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.708125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.708125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.708125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.708125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.708125] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.826655] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 568476d9-5d54-4140-a95b-b3115de0a46f [ 1032.826890] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.827116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.827116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.827316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.827403] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.827504] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:568476d9-5d54-4140-a95b-b3115de0a46f already deleted. [ 1032.827584] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-568476d9-5d54-4140-a95b-b3115de0a46f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.086132] env[69491]: INFO networking_nsxv3.common.synchronization [req-7a116279-5778-4c19-ab5e-e96782c94e4d req-8c1314ad-2e64-4430-8056-f9daf08f2d07 tempest-ServerTagsTestJSON-2019135178 tempest-ServerTagsTestJSON-2019135178-project-member] Enqueued Resource ID: c01fe6e7-4574-4c6a-973e-552160230574 with Priority: HIGHEST for action security_group_members [ 1033.087457] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c01fe6e7-4574-4c6a-973e-552160230574 with Priority: HIGHEST for action security_group_members [ 1033.087457] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-c01fe6e7-4574-4c6a-973e-552160230574 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.087457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.087457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.089735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.089735] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.089735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.089735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.089735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.089735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.089735] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c01fe6e7-4574-4c6a-973e-552160230574',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.212476] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d226f0cc-ed68-4bbb-a45f-f167f2ea29ab: rpc.has_security_group_logging(os_id): False [ 1033.231928] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.231928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.231928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.232175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.232378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.232462] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.232563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.232622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.232862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.232915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.233110] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.233211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.233270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.233423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.233597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.233851] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.234047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.234172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.234348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.234431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.234693] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab is going to be updated. [ 1033.307056] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.307056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.307056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.307056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.307056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.319110] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: IN_PROGRESS for 2s [ 1033.591287] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.591502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.591616] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.591967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.592121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.592386] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.592524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.592606] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.592810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.592910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.593037] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c01fe6e7-4574-4c6a-973e-552160230574 already deleted. [ 1033.593133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.871184] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.871399] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-838" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.871532] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-838" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.871863] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-838" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.872150] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.872315] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.872438] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.872663] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.872817] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.873058] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1033.875390] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1033.875390] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1033.875390] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1033.875390] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1033.875390] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1033.875390] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1033.898033] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1033.898033] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1033.898033] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1033.898033] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-838" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.898033] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-bf129ad2-b4fb-4236-a09a-48fc5e10c728 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.898033] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-bf129ad2-b4fb-4236-a09a-48fc5e10c728" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.898033] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-bf129ad2-b4fb-4236-a09a-48fc5e10c728" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.898033] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-bf129ad2-b4fb-4236-a09a-48fc5e10c728" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.898033] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf129ad2-b4fb-4236-a09a-48fc5e10c728',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.296987] env[69491]: INFO networking_nsxv3.common.synchronization [None req-34d0519d-719e-46f3-9038-394ef4917955 None None] Enqueued Resource ID: 3b71a8b7-e93e-4c88-acf7-da1b967a5bd3 with Priority: HIGHEST for action port [ 1034.297351] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b71a8b7-e93e-4c88-acf7-da1b967a5bd3 with Priority: HIGHEST for action port [ 1034.297958] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b71a8b7-e93e-4c88-acf7-da1b967a5bd3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.298061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b71a8b7-e93e-4c88-acf7-da1b967a5bd3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.298135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b71a8b7-e93e-4c88-acf7-da1b967a5bd3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.298378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b71a8b7-e93e-4c88-acf7-da1b967a5bd3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.298458] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b71a8b7-e93e-4c88-acf7-da1b967a5bd3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.404204] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.404204] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.404204] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.404204] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.404204] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.407666] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port bf129ad2-b4fb-4236-a09a-48fc5e10c728 not found, creating... [ 1034.407666] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.407666] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.407666] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.407666] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.407666] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.407666] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.407666] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.407666] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.407666] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.408061] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.408061] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: bf129ad2-b4fb-4236-a09a-48fc5e10c728 is going to be created. [ 1034.430377] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.430604] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.430755] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.431038] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.431279] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.431501] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-bf129ad2-b4fb-4236-a09a-48fc5e10c728" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.509018] env[69491]: INFO networking_nsxv3.common.synchronization [None req-41a9b194-b1ed-46ec-9c32-1e2ef38d9420 None None] Enqueued Resource ID: dfb960b5-7dec-457d-a26a-66c56fa739e3 with Priority: HIGHEST for action port [ 1034.509018] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfb960b5-7dec-457d-a26a-66c56fa739e3 with Priority: HIGHEST for action port [ 1034.509018] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfb960b5-7dec-457d-a26a-66c56fa739e3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.509018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfb960b5-7dec-457d-a26a-66c56fa739e3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.509018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfb960b5-7dec-457d-a26a-66c56fa739e3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.509842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfb960b5-7dec-457d-a26a-66c56fa739e3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.509982] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfb960b5-7dec-457d-a26a-66c56fa739e3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.805259] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b71a8b7-e93e-4c88-acf7-da1b967a5bd3 [ 1034.806680] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.806680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.806680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.806680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.806680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.806680] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b71a8b7-e93e-4c88-acf7-da1b967a5bd3 already deleted. [ 1034.806680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b71a8b7-e93e-4c88-acf7-da1b967a5bd3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.015275] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfb960b5-7dec-457d-a26a-66c56fa739e3 [ 1035.015339] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.015531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.015597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.015809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.016374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.016512] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfb960b5-7dec-457d-a26a-66c56fa739e3 already deleted. [ 1035.019019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfb960b5-7dec-457d-a26a-66c56fa739e3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.189334] env[69491]: INFO networking_nsxv3.common.synchronization [req-7a116279-5778-4c19-ab5e-e96782c94e4d req-5fd8d6e1-bd88-4cfb-9505-ed25908c0d20 service nova] Enqueued Resource ID: c01fe6e7-4574-4c6a-973e-552160230574 with Priority: HIGHEST for action security_group_rules [ 1035.189334] env[69491]: INFO networking_nsxv3.common.synchronization [req-7a116279-5778-4c19-ab5e-e96782c94e4d req-5fd8d6e1-bd88-4cfb-9505-ed25908c0d20 service nova] Enqueued Resource ID: c01fe6e7-4574-4c6a-973e-552160230574 with Priority: HIGHEST for action security_group_members [ 1035.189334] env[69491]: INFO networking_nsxv3.common.synchronization [req-7a116279-5778-4c19-ab5e-e96782c94e4d req-5fd8d6e1-bd88-4cfb-9505-ed25908c0d20 service nova] Enqueued Resource ID: bf129ad2-b4fb-4236-a09a-48fc5e10c728 with Priority: HIGHEST for action port [ 1035.189334] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c01fe6e7-4574-4c6a-973e-552160230574 with Priority: HIGHEST for action security_group_rules [ 1035.189532] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c01fe6e7-4574-4c6a-973e-552160230574 with Priority: HIGHEST for action security_group_members [ 1035.189532] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf129ad2-b4fb-4236-a09a-48fc5e10c728 with Priority: HIGHEST for action port [ 1035.190657] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c01fe6e7-4574-4c6a-973e-552160230574 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.190790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.190854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.191208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.191264] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c01fe6e7-4574-4c6a-973e-552160230574',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.192166] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-c01fe6e7-4574-4c6a-973e-552160230574 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.192293] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.192364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.192543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.192716] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.192835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.192902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.193072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.193147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.193924] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c01fe6e7-4574-4c6a-973e-552160230574',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.194125] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf129ad2-b4fb-4236-a09a-48fc5e10c728 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.194266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf129ad2-b4fb-4236-a09a-48fc5e10c728" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.194339] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf129ad2-b4fb-4236-a09a-48fc5e10c728" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.194467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf129ad2-b4fb-4236-a09a-48fc5e10c728" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.194568] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf129ad2-b4fb-4236-a09a-48fc5e10c728',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.336423] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: SUCCESS [ 1035.336706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.394766] env[69491]: INFO networking_nsxv3.common.synchronization [req-02b5cc4f-3164-46d0-a00a-a0c424d1229c req-996b01aa-f146-447c-bce3-5b4688a5da0b tempest-ServersNegativeTestMultiTenantJSON-1571590929 tempest-ServersNegativeTestMultiTenantJSON-1571590929-project-member] Enqueued Resource ID: f14cf56d-2a11-4dcf-9f65-92e04445741f with Priority: HIGHEST for action security_group_members [ 1035.395600] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f14cf56d-2a11-4dcf-9f65-92e04445741f with Priority: HIGHEST for action security_group_members [ 1035.395950] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f14cf56d-2a11-4dcf-9f65-92e04445741f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.397280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.397372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.397730] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.397954] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.398111] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.398212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.398415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.398471] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.398567] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f14cf56d-2a11-4dcf-9f65-92e04445741f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.700859] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c01fe6e7-4574-4c6a-973e-552160230574',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.701384] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-c01fe6e7-4574-4c6a-973e-552160230574 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.701506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.701734] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf129ad2-b4fb-4236-a09a-48fc5e10c728 with status ACTIVE [ 1035.701809] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.701998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.701998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.702195] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.702281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.702451] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.702546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.702605] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.702788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.702870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.706500] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.706669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.707041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.707041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.707041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.707199] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf129ad2-b4fb-4236-a09a-48fc5e10c728 is going to be updated. [ 1035.731623] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.731831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.731831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.732035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.732166] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.732315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf129ad2-b4fb-4236-a09a-48fc5e10c728" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.904874] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.904874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.904874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.904874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.904874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.904874] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.904874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.904874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.904874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.904874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.904874] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f14cf56d-2a11-4dcf-9f65-92e04445741f already deleted. [ 1035.904874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.060271] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.060565] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-616" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.060636] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-616" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.061315] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-616" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.061776] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.062044] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.062232] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.062638] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.062884] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.063253] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.063538] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1036.063676] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1036.063869] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1036.064080] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.064299] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1036.064542] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.088793] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1036.089104] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1036.089233] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1036.089492] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-616" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.089815] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-03f42120-b722-4980-a9cb-c8e68a6f05c2 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.090044] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-03f42120-b722-4980-a9cb-c8e68a6f05c2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.090173] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-03f42120-b722-4980-a9cb-c8e68a6f05c2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.090538] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-03f42120-b722-4980-a9cb-c8e68a6f05c2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.090686] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03f42120-b722-4980-a9cb-c8e68a6f05c2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.209964] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c01fe6e7-4574-4c6a-973e-552160230574',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.597792] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.598210] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.598260] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.598570] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.598702] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.598889] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 03f42120-b722-4980-a9cb-c8e68a6f05c2 not found, creating... [ 1036.599191] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.599376] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.599526] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.599807] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.599922] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.600240] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.600405] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.600544] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.601381] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.601590] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.602083] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 03f42120-b722-4980-a9cb-c8e68a6f05c2 is going to be created. [ 1036.624495] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.624752] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.626269] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.626574] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.626857] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.627133] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-03f42120-b722-4980-a9cb-c8e68a6f05c2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.713071] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.713212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.713254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.713461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.713554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.713665] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c01fe6e7-4574-4c6a-973e-552160230574 is going to be created. [ 1036.749576] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.749576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.749576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.749576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.749576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.759079] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c01fe6e7-4574-4c6a-973e-552160230574 in Status: UNINITIALIZED for 2s [ 1036.808019] env[69491]: INFO networking_nsxv3.common.synchronization [None req-80e00fe7-fc13-44bc-a267-9a45b0e3aca0 None None] Enqueued Resource ID: 32986e74-a88b-431e-bd76-93db391dba09 with Priority: HIGHEST for action port [ 1036.808019] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32986e74-a88b-431e-bd76-93db391dba09 with Priority: HIGHEST for action port [ 1036.808019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-32986e74-a88b-431e-bd76-93db391dba09 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.808019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32986e74-a88b-431e-bd76-93db391dba09" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.808019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32986e74-a88b-431e-bd76-93db391dba09" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.808019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32986e74-a88b-431e-bd76-93db391dba09" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.808019] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32986e74-a88b-431e-bd76-93db391dba09',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.311291] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32986e74-a88b-431e-bd76-93db391dba09 [ 1037.311291] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.311402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.311503] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.311669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.311760] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.311858] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32986e74-a88b-431e-bd76-93db391dba09 already deleted. [ 1037.311941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32986e74-a88b-431e-bd76-93db391dba09" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.578523] env[69491]: INFO networking_nsxv3.common.synchronization [req-02b5cc4f-3164-46d0-a00a-a0c424d1229c req-f100f1bd-dacc-4304-bdbc-5001d47ff480 service nova] Enqueued Resource ID: f14cf56d-2a11-4dcf-9f65-92e04445741f with Priority: HIGHEST for action security_group_rules [ 1037.578654] env[69491]: INFO networking_nsxv3.common.synchronization [req-02b5cc4f-3164-46d0-a00a-a0c424d1229c req-f100f1bd-dacc-4304-bdbc-5001d47ff480 service nova] Enqueued Resource ID: f14cf56d-2a11-4dcf-9f65-92e04445741f with Priority: HIGHEST for action security_group_members [ 1037.578803] env[69491]: INFO networking_nsxv3.common.synchronization [req-02b5cc4f-3164-46d0-a00a-a0c424d1229c req-f100f1bd-dacc-4304-bdbc-5001d47ff480 service nova] Enqueued Resource ID: 03f42120-b722-4980-a9cb-c8e68a6f05c2 with Priority: HIGHEST for action port [ 1037.579180] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f14cf56d-2a11-4dcf-9f65-92e04445741f with Priority: HIGHEST for action security_group_rules [ 1037.579240] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f14cf56d-2a11-4dcf-9f65-92e04445741f with Priority: HIGHEST for action security_group_members [ 1037.579338] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03f42120-b722-4980-a9cb-c8e68a6f05c2 with Priority: HIGHEST for action port [ 1037.579891] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f14cf56d-2a11-4dcf-9f65-92e04445741f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.580034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.580105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.580360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.580443] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f14cf56d-2a11-4dcf-9f65-92e04445741f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.581273] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f14cf56d-2a11-4dcf-9f65-92e04445741f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.581392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.581447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.581610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.581784] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.581889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.581953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.583147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.583147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.583147] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f14cf56d-2a11-4dcf-9f65-92e04445741f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.583560] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-03f42120-b722-4980-a9cb-c8e68a6f05c2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.583560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03f42120-b722-4980-a9cb-c8e68a6f05c2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.583560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03f42120-b722-4980-a9cb-c8e68a6f05c2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.583560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03f42120-b722-4980-a9cb-c8e68a6f05c2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.583884] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03f42120-b722-4980-a9cb-c8e68a6f05c2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.085108] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f14cf56d-2a11-4dcf-9f65-92e04445741f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.086165] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f14cf56d-2a11-4dcf-9f65-92e04445741f taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.086274] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.086446] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03f42120-b722-4980-a9cb-c8e68a6f05c2 with status ACTIVE [ 1038.086600] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.086698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.086761] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.087077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.087163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.087334] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.088294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.088294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.088294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.088294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.088294] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.088294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.088294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.088294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.088294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.088762] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03f42120-b722-4980-a9cb-c8e68a6f05c2 is going to be updated. [ 1038.110855] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.110855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.111072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.111214] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.111414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.112241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03f42120-b722-4980-a9cb-c8e68a6f05c2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.590871] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f14cf56d-2a11-4dcf-9f65-92e04445741f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.769034] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c01fe6e7-4574-4c6a-973e-552160230574 in Status: SUCCESS [ 1038.769260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.769430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.769647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.770348] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.770348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.770348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.770538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.770538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.770601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.770735] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c01fe6e7-4574-4c6a-973e-552160230574',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.093793] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.094159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.094159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.094310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.094348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.095164] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f14cf56d-2a11-4dcf-9f65-92e04445741f is going to be created. [ 1039.120320] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.120475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.120555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.120758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.120926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.134990] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f14cf56d-2a11-4dcf-9f65-92e04445741f in Status: UNINITIALIZED for 2s [ 1039.272977] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-c01fe6e7-4574-4c6a-973e-552160230574 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.273155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.273228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.273537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.274153] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.274153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.274153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.274153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.274153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.274424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.274526] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-c01fe6e7-4574-4c6a-973e-552160230574 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.275061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.275061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.275061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.275061] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.275253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.275253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.275314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.275354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.275440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.275527] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c01fe6e7-4574-4c6a-973e-552160230574',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.732751] env[69491]: INFO networking_nsxv3.common.synchronization [req-5a022f3d-67df-4615-8303-f4691868a2a9 req-c7b6327a-384c-4903-b656-665d0d4bc517 tempest-ServerRescueNegativeTestJSON-1517573171 tempest-ServerRescueNegativeTestJSON-1517573171-project-member] Enqueued Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGHEST for action security_group_members [ 1039.733383] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGHEST for action security_group_members [ 1039.733763] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdef2989-64ee-40c2-bd6c-f47c52643b88 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.733907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.733977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.735311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.735526] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.735651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.735720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.735962] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.735962] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.736119] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdef2989-64ee-40c2-bd6c-f47c52643b88',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.778303] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c01fe6e7-4574-4c6a-973e-552160230574: rpc.has_security_group_logging(os_id): False [ 1039.799890] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.800152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.800152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.800443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.800538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.800786] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.800909] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.800966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.801155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.801241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.801429] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.801526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.801588] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.801784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.801911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.803142] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.803142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.803142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.803142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.803142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.803142] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c01fe6e7-4574-4c6a-973e-552160230574 is going to be created. [ 1039.869042] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.869042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.869042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.869283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.869319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.885632] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c01fe6e7-4574-4c6a-973e-552160230574 in Status: IN_PROGRESS for 2s [ 1040.109239] env[69491]: INFO networking_nsxv3.common.synchronization [req-8fb7c33d-3e17-43e7-b6e3-f401396f55ba req-1b3c9dbf-2761-434e-ac19-529162197aae tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_members [ 1040.109956] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_members [ 1040.110382] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.110567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.110717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.111128] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.111295] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.111421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.111570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.111865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.112082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.112290] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.238499] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.238672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.238748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.239053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.275392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.275829] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.276179] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.276179] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.276268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.276302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.276790] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 is going to be updated. [ 1040.310870] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.313122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.313270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.313545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.313740] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.324692] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 in Status: IN_PROGRESS for 2s [ 1040.620743] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.620992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.621116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.621393] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.621835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.622280] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.622981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.625017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.625017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.625017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.625017] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 already deleted. [ 1040.625017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.679916] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.680287] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.680465] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.680742] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.681034] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.681181] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.681342] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.681599] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.681779] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.681967] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.682110] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.682228] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.682341] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.682458] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.682571] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.682732] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.702398] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.702398] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1040.702398] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.702662] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.702912] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-f590b10c-14fe-43a4-816f-e83190273e6a taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.703105] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-f590b10c-14fe-43a4-816f-e83190273e6a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.703233] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-f590b10c-14fe-43a4-816f-e83190273e6a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.703754] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-f590b10c-14fe-43a4-816f-e83190273e6a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.703915] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f590b10c-14fe-43a4-816f-e83190273e6a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.147814] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f14cf56d-2a11-4dcf-9f65-92e04445741f in Status: SUCCESS [ 1041.147814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.148310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.148310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.148407] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.148544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.148603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.148804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.148873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.149041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.149120] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f14cf56d-2a11-4dcf-9f65-92e04445741f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.206276] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.206769] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.207024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.207398] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.207616] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.207816] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port f590b10c-14fe-43a4-816f-e83190273e6a not found, creating... [ 1041.208151] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.208372] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.208526] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.208793] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.211568] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.211568] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.211568] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.211568] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.211568] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.211568] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.211568] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: f590b10c-14fe-43a4-816f-e83190273e6a is going to be created. [ 1041.243202] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.243447] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.243581] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.243873] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.244134] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.244377] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-f590b10c-14fe-43a4-816f-e83190273e6a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.655030] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f14cf56d-2a11-4dcf-9f65-92e04445741f taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.655030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.655030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.655030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.655030] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.655030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.655030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.655030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.655030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.655030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.655030] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f14cf56d-2a11-4dcf-9f65-92e04445741f taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.655030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.655030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.655030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.655030] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.655030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.655814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.655814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.655814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.655814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.655814] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f14cf56d-2a11-4dcf-9f65-92e04445741f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.897181] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c01fe6e7-4574-4c6a-973e-552160230574 in Status: SUCCESS [ 1041.897569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.162356] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f14cf56d-2a11-4dcf-9f65-92e04445741f: rpc.has_security_group_logging(os_id): False [ 1042.183143] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.183647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.183766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.184070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.184168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.184435] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.184575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.184642] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.184823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.184903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.185126] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.185329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.185433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.185603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.185689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.185923] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.186266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.186266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.186399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.186399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.186497] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f14cf56d-2a11-4dcf-9f65-92e04445741f is going to be created. [ 1042.225549] env[69491]: INFO networking_nsxv3.common.synchronization [req-8fb7c33d-3e17-43e7-b6e3-f401396f55ba req-9ed049c9-eba4-4702-abda-77e7f607b91c service nova] Enqueued Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_rules [ 1042.225549] env[69491]: INFO networking_nsxv3.common.synchronization [req-8fb7c33d-3e17-43e7-b6e3-f401396f55ba req-9ed049c9-eba4-4702-abda-77e7f607b91c service nova] Enqueued Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_members [ 1042.225549] env[69491]: INFO networking_nsxv3.common.synchronization [req-8fb7c33d-3e17-43e7-b6e3-f401396f55ba req-9ed049c9-eba4-4702-abda-77e7f607b91c service nova] Enqueued Resource ID: f590b10c-14fe-43a4-816f-e83190273e6a with Priority: HIGHEST for action port [ 1042.225549] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_rules [ 1042.225549] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_members [ 1042.225549] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f590b10c-14fe-43a4-816f-e83190273e6a with Priority: HIGHEST for action port [ 1042.225549] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.225815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.225815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.226037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.226103] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.227034] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.227168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.227236] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.227429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.227592] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.227692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.227756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.227904] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.227989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.228164] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.229690] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f590b10c-14fe-43a4-816f-e83190273e6a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.229833] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f590b10c-14fe-43a4-816f-e83190273e6a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.230260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f590b10c-14fe-43a4-816f-e83190273e6a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.231550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f590b10c-14fe-43a4-816f-e83190273e6a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.231640] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f590b10c-14fe-43a4-816f-e83190273e6a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.271409] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.271658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.271658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.271889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.272091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.286863] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f14cf56d-2a11-4dcf-9f65-92e04445741f in Status: IN_PROGRESS for 2s [ 1042.342728] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 in Status: SUCCESS [ 1042.342948] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 deletion is rescheduled due to dependency. [ 1042.343063] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.733695] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.733819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.734027] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.734938] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f590b10c-14fe-43a4-816f-e83190273e6a with status ACTIVE [ 1042.735128] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.735240] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.735303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.735569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.735663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.735844] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.735935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.735992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.736202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.736257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.736393] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.736520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.736572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.736716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.736789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.736833] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f590b10c-14fe-43a4-816f-e83190273e6a is going to be updated. [ 1042.759600] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.759749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.759813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.760051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.760196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.760352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f590b10c-14fe-43a4-816f-e83190273e6a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.062031] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-922 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.062031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-922" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.062031] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-922" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.062287] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-922" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.062396] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.062621] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.062771] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.063024] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.063176] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.063396] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1043.063516] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1043.063637] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1043.063804] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1043.063863] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1043.063964] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1043.064148] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1043.083893] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1043.084112] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1043.084251] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1043.084440] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-922" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.084760] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-64bb0326-dc96-4647-9145-fe361fbed7fe taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.084935] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.085072] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.085399] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.085633] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64bb0326-dc96-4647-9145-fe361fbed7fe',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.241221] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.589013] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.589383] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.589530] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.589834] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.589992] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.590332] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.590504] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.590625] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.590856] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.591008] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.591319] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.591482] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.591601] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.591815] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.592130] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.592321] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 64bb0326-dc96-4647-9145-fe361fbed7fe is going to be updated. [ 1043.619415] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.620273] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.620618] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.621095] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.621465] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.621897] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.743598] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.744852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.744852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.744852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.744852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.744852] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 is going to be created. [ 1043.880065] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.880269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.880353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.880600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.880771] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.893968] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: UNINITIALIZED for 2s [ 1044.299905] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f14cf56d-2a11-4dcf-9f65-92e04445741f in Status: SUCCESS [ 1044.299905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.575572] env[69491]: INFO networking_nsxv3.common.synchronization [req-0219173e-fa28-4886-b5d3-ca3164f042a8 req-3d55710b-e7f3-46c3-b9bb-49fbfaab6c3f service nova] Enqueued Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_rules [ 1044.575783] env[69491]: INFO networking_nsxv3.common.synchronization [req-0219173e-fa28-4886-b5d3-ca3164f042a8 req-3d55710b-e7f3-46c3-b9bb-49fbfaab6c3f service nova] Enqueued Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 1044.575957] env[69491]: INFO networking_nsxv3.common.synchronization [req-0219173e-fa28-4886-b5d3-ca3164f042a8 req-3d55710b-e7f3-46c3-b9bb-49fbfaab6c3f service nova] Enqueued Resource ID: 64bb0326-dc96-4647-9145-fe361fbed7fe with Priority: HIGHEST for action port [ 1044.576477] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_rules [ 1044.576604] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 1044.576699] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64bb0326-dc96-4647-9145-fe361fbed7fe with Priority: HIGHEST for action port [ 1044.577025] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.578468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.578569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.578760] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.578848] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.582209] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.582336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.582406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.582618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.582785] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.582877] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.582933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.583140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.583230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.583350] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.584998] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-64bb0326-dc96-4647-9145-fe361fbed7fe taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.584998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.584998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.584998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.584998] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64bb0326-dc96-4647-9145-fe361fbed7fe',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.082927] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.083191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.086632] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.087670] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64bb0326-dc96-4647-9145-fe361fbed7fe with status ACTIVE [ 1045.087881] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.088026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.088097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.088307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.088399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.088581] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.088728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.088842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.089052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.089190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.089423] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.089505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.089542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.089675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.089745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.089830] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64bb0326-dc96-4647-9145-fe361fbed7fe is going to be updated. [ 1045.112381] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.112533] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.112605] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.112838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.113012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.113312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64bb0326-dc96-4647-9145-fe361fbed7fe" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.592423] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.904441] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: SUCCESS [ 1045.904838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.904937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.905116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.905315] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.905477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.905534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.905636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.905717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.905804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.905901] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.096941] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.097136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.097232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.097459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.097555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.097660] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 is going to be updated. [ 1046.130494] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.130666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.130755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.131017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.131185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.141606] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: IN_PROGRESS for 2s [ 1046.411017] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.914304] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2718fb34-4e94-4380-bd09-5b025d3b2125: rpc.has_security_group_logging(os_id): False [ 1046.941037] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.941037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.941037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.941037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.941037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.941351] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.941400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.941433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.941575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.941790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.941790] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 is going to be created. [ 1047.017698] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.017860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.017959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.018301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.018526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.032587] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: IN_PROGRESS for 2s [ 1048.152900] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: IN_PROGRESS for 4s [ 1049.046693] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: SUCCESS [ 1049.046693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.577503] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1049.577503] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1049.595428] env[69491]: INFO networking_nsxv3.common.synchronization [req-456ea870-189d-41d1-9738-b57ed8202c5a req-8851e2a1-d321-4937-a14b-f4732d447bca tempest-ServerTagsTestJSON-2019135178 tempest-ServerTagsTestJSON-2019135178-project-member] Enqueued Resource ID: c01fe6e7-4574-4c6a-973e-552160230574 with Priority: HIGHEST for action security_group_members [ 1049.599024] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c01fe6e7-4574-4c6a-973e-552160230574 with Priority: HIGHEST for action security_group_members [ 1049.599024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-c01fe6e7-4574-4c6a-973e-552160230574 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.599024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.599024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.599024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.599024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.599024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.599024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.599024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.599024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.599024] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c01fe6e7-4574-4c6a-973e-552160230574',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.104300] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.104300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.104300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.104300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.104300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.104300] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.104300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.104300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.104300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.105442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.105442] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c01fe6e7-4574-4c6a-973e-552160230574 is going to be updated. [ 1050.157035] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.157035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.157035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.157035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.157035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.175800] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: SUCCESS [ 1050.176165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.176381] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.176659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.176954] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.177120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.177282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.177424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.177560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.177683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.177803] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.179459] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c01fe6e7-4574-4c6a-973e-552160230574 in Status: IN_PROGRESS for 2s [ 1050.301018] env[69491]: INFO networking_nsxv3.common.synchronization [req-3e83bd15-439f-4157-afe8-e5aae42d0319 req-852756ac-734e-4440-b069-6707ba87d4de tempest-ServersNegativeTestMultiTenantJSON-1571590929 tempest-ServersNegativeTestMultiTenantJSON-1571590929-project-member] Enqueued Resource ID: f14cf56d-2a11-4dcf-9f65-92e04445741f with Priority: HIGHEST for action security_group_members [ 1050.301018] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f14cf56d-2a11-4dcf-9f65-92e04445741f with Priority: HIGHEST for action security_group_members [ 1050.303098] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-f14cf56d-2a11-4dcf-9f65-92e04445741f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.303464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.303675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.304479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.304780] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.305026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.305180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.305538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.306473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.306473] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f14cf56d-2a11-4dcf-9f65-92e04445741f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.681034] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.681034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.681034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.681532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.681532] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.681532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.681532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.681760] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.682107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.682107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.682107] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.682277] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.682277] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.682396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.682559] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.682682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.682742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.682888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.682977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.683184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.683245] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.810154] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.810415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.810532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.810830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.810962] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.811288] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.813211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.813211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.813211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.813211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.813211] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f14cf56d-2a11-4dcf-9f65-92e04445741f is going to be updated. [ 1050.844338] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.844338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.844338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.844676] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.844676] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.858753] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f14cf56d-2a11-4dcf-9f65-92e04445741f in Status: IN_PROGRESS for 2s [ 1051.186410] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fafd77cc-d50d-41af-b588-6629e9cea514: rpc.has_security_group_logging(os_id): False [ 1051.214284] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.214462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.214532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.214762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.238396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.241032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.241032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.241032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.241032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.241032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.241032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.241032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.241032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.241032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.241032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.241032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.241032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.241032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.241032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.241920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.241920] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 is going to be updated. [ 1051.322594] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.322911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.322911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.323008] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.323146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.345428] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: IN_PROGRESS for 2s [ 1052.192487] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c01fe6e7-4574-4c6a-973e-552160230574 in Status: SUCCESS [ 1052.192815] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c01fe6e7-4574-4c6a-973e-552160230574 deletion is rescheduled due to dependency. [ 1052.192886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c01fe6e7-4574-4c6a-973e-552160230574" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.873091] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f14cf56d-2a11-4dcf-9f65-92e04445741f in Status: SUCCESS [ 1052.873091] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f14cf56d-2a11-4dcf-9f65-92e04445741f deletion is rescheduled due to dependency. [ 1052.873091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.910312] env[69491]: INFO networking_nsxv3.common.synchronization [req-c7e0453b-0cb2-4d76-8765-f4ecc86d5660 req-bcd679f1-ce98-4254-97c8-7ca966ff94ab tempest-ServerRescueTestJSON-1463555039 tempest-ServerRescueTestJSON-1463555039-project-member] Enqueued Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_members [ 1052.911458] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_members [ 1052.911458] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.911458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.911675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.912185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.912185] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.912185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.912185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.912397] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.912483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.912577] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.361999] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: SUCCESS [ 1053.362385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.415783] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.669792] env[69491]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1053.669792] env[69491]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1053.723825] env[69491]: INFO networking_nsxv3.common.synchronization [req-5b29090e-186d-4ac3-bff8-05c27bff6601 req-9cf54e3d-3717-4e11-837c-cf4d8d02db7c tempest-ServersAdminTestJSON-362478418 tempest-ServersAdminTestJSON-362478418-project-member] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 1053.728882] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 1053.728882] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.728882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.728882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.728882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.728882] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.728882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.728882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.728882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.728882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.728882] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.741284] env[69491]: INFO networking_nsxv3.common.synchronization [req-f38efbbf-06d2-4731-8dbf-f10b709604a6 req-057d9daa-3550-4456-b3a6-f4278a9f2cdc tempest-ImagesTestJSON-1178517317 tempest-ImagesTestJSON-1178517317-project-member] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 1053.741284] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 1053.743475] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.743892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.744175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.747695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.747695] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.747695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.747695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.747695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.747695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.747695] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.923437] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.230663] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.252685] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.252971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.253078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.253312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.253458] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.253676] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.253777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.253846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.254008] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.254093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.254179] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 1054.262967] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.263311] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.263311] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.263699] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.263913] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.264090] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.264217] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.264498] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.265032] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.265032] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.265168] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.265259] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.265338] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.265442] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.265557] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.265815] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.283381] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.283663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.283663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.283827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.283947] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.287951] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.288139] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1054.288287] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.288484] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-846" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.288865] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-0d9c82b3-1294-42f4-b2b1-b31feb0449d0 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.289087] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-0d9c82b3-1294-42f4-b2b1-b31feb0449d0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.289222] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-0d9c82b3-1294-42f4-b2b1-b31feb0449d0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.289626] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-0d9c82b3-1294-42f4-b2b1-b31feb0449d0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.289734] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d9c82b3-1294-42f4-b2b1-b31feb0449d0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.296537] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 1054.425755] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.426279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.426279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.426279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.426483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.426483] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab is going to be updated. [ 1054.458177] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.458338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.458385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.458588] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.458734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.468132] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: IN_PROGRESS for 2s [ 1054.734042] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.735674] env[69491]: INFO networking_nsxv3.common.synchronization [req-4f4ee833-69b8-4cdf-ba36-61c7711c41fd req-9212d1d2-b0ec-43ae-9e6b-e373becd2b04 tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGHEST for action security_group_members [ 1054.736817] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGHEST for action security_group_members [ 1054.736817] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-62c4aff5-ba77-43c8-9eb6-a56da143180b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.736817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.736817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.736817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.736817] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.736817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.737146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.737146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.737217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.738690] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.793034] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.793034] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.793034] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.793682] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.793682] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.793682] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 0d9c82b3-1294-42f4-b2b1-b31feb0449d0 not found, creating... [ 1054.793888] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.794061] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.794189] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.795042] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.795042] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.795042] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.795315] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.795315] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.795392] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.795529] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.795673] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 0d9c82b3-1294-42f4-b2b1-b31feb0449d0 is going to be created. [ 1054.816569] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.816802] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.816969] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.817288] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.817529] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.817986] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-0d9c82b3-1294-42f4-b2b1-b31feb0449d0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.236932] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.237172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.237221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.237429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.237520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.237626] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 1055.242823] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.243039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.243039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.243140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.263662] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.263981] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.264150] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.264216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.264424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.264521] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.264616] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b is going to be updated. [ 1055.278645] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.278830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.278905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.279185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.279355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.287591] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 1055.294254] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.294484] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.294484] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.294693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.294828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.303660] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b in Status: IN_PROGRESS for 2s [ 1055.685756] env[69491]: INFO networking_nsxv3.common.synchronization [req-f38efbbf-06d2-4731-8dbf-f10b709604a6 req-ad8d0a56-5a35-4246-a6c2-6b0f99befbbc service nova] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_rules [ 1055.686114] env[69491]: INFO networking_nsxv3.common.synchronization [req-f38efbbf-06d2-4731-8dbf-f10b709604a6 req-ad8d0a56-5a35-4246-a6c2-6b0f99befbbc service nova] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 1055.686114] env[69491]: INFO networking_nsxv3.common.synchronization [req-f38efbbf-06d2-4731-8dbf-f10b709604a6 req-ad8d0a56-5a35-4246-a6c2-6b0f99befbbc service nova] Enqueued Resource ID: 0d9c82b3-1294-42f4-b2b1-b31feb0449d0 with Priority: HIGHEST for action port [ 1055.686367] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_rules [ 1055.686603] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 1055.686603] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d9c82b3-1294-42f4-b2b1-b31feb0449d0 with Priority: HIGHEST for action port [ 1055.689859] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.690030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.690073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.690741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.690741] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.692016] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.692138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.692826] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d9c82b3-1294-42f4-b2b1-b31feb0449d0 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.692826] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d9c82b3-1294-42f4-b2b1-b31feb0449d0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.693047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d9c82b3-1294-42f4-b2b1-b31feb0449d0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.694866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d9c82b3-1294-42f4-b2b1-b31feb0449d0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.694866] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d9c82b3-1294-42f4-b2b1-b31feb0449d0',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.193250] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.193250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.195596] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d9c82b3-1294-42f4-b2b1-b31feb0449d0 with status ACTIVE [ 1056.195821] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.195949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.196031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.196248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.196352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.196575] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.196672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.196749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.196886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.196964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.197152] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.197244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.197305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.197441] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.197510] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.197652] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d9c82b3-1294-42f4-b2b1-b31feb0449d0 is going to be updated. [ 1056.256665] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.256665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.256665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.256665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.256665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.256665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d9c82b3-1294-42f4-b2b1-b31feb0449d0" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.344280] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 1056.344280] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 deletion is rescheduled due to dependency. [ 1056.344280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.344280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.344280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.344280] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.344280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.344280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.344280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.344280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.344280] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.482088] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: SUCCESS [ 1056.482335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.822335] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.301462] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 1057.301687] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.316111] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b in Status: SUCCESS [ 1057.316330] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b deletion is rescheduled due to dependency. [ 1057.316447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.328026] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.831034] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.831405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.831405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.831561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.831655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.831756] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 1057.863538] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.863741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.863741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.863920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.864092] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.875612] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 1059.892036] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 1059.892036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.892036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.892036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.892036] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.892036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.892036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.892036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.892036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.892036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.892036] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.395423] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.395665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.395665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.395886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.396068] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.396168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.396231] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.396375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.396461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.396561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.396697] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.396791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.396852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.396990] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.397139] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.397229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.397287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.397419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.397490] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.397568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.397668] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.687747] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1060.687945] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1060.900185] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9028d23d-9b03-48da-a060-d720486e9412: rpc.has_security_group_logging(os_id): False [ 1060.918645] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.918799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.918875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.919106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.919447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.919447] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.919579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.919579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.919721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.919889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.920123] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.920300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.920300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.920461] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.920553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.921300] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.921300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.921300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.921300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.921300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.921300] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 1060.985274] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.985425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.985512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.985726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.985842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.003220] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 1063.018900] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 1063.019237] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.326865] env[69491]: INFO networking_nsxv3.common.synchronization [req-681c785f-e714-4ca3-ad9a-648b2bd7fc54 req-313eeefe-f402-4b36-bc3f-6c7a71a03ed2 tempest-AttachVolumeTestJSON-1247015010 tempest-AttachVolumeTestJSON-1247015010-project-member] Enqueued Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGHEST for action security_group_members [ 1064.327432] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGHEST for action security_group_members [ 1064.327739] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-796dade6-def8-42b0-adbd-7347623ab0c8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.327888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.327979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.328278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.328399] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.329286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.329286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.329286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.329286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.329286] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.622802] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-304 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.623093] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-304" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.623247] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-304" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.623735] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-304" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.624077] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.624282] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.624454] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.624712] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.624965] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.625236] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.625371] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.625533] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.626151] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.626345] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.626486] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.626654] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.646458] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.646710] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.646777] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.646953] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-304" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.647345] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-aead3f3b-f2f8-43d8-8761-7f291c9f3d34 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.647531] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-aead3f3b-f2f8-43d8-8761-7f291c9f3d34" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.647658] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-aead3f3b-f2f8-43d8-8761-7f291c9f3d34" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.647993] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-aead3f3b-f2f8-43d8-8761-7f291c9f3d34" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.648170] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aead3f3b-f2f8-43d8-8761-7f291c9f3d34',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.832812] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.832812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.832812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.833040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.833040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.833315] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.833451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.833451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.834225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.834225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.834225] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 796dade6-def8-42b0-adbd-7347623ab0c8 already deleted. [ 1064.834225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.151347] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.151347] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.151347] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.151347] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.151579] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.151743] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port aead3f3b-f2f8-43d8-8761-7f291c9f3d34 not found, creating... [ 1065.152051] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.152256] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.152423] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.152689] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.152842] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.153176] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.153347] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.153472] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.153714] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.153860] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.154029] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: aead3f3b-f2f8-43d8-8761-7f291c9f3d34 is going to be created. [ 1065.187106] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.187439] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.187618] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.187979] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.188331] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.188636] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-aead3f3b-f2f8-43d8-8761-7f291c9f3d34" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.912515] env[69491]: INFO networking_nsxv3.common.synchronization [req-681c785f-e714-4ca3-ad9a-648b2bd7fc54 req-e69b4a0a-07d8-49ba-bc9a-ed100999318b service nova] Enqueued Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGHEST for action security_group_rules [ 1065.912757] env[69491]: INFO networking_nsxv3.common.synchronization [req-681c785f-e714-4ca3-ad9a-648b2bd7fc54 req-e69b4a0a-07d8-49ba-bc9a-ed100999318b service nova] Enqueued Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGHEST for action security_group_members [ 1065.912852] env[69491]: INFO networking_nsxv3.common.synchronization [req-681c785f-e714-4ca3-ad9a-648b2bd7fc54 req-e69b4a0a-07d8-49ba-bc9a-ed100999318b service nova] Enqueued Resource ID: aead3f3b-f2f8-43d8-8761-7f291c9f3d34 with Priority: HIGHEST for action port [ 1065.913113] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGHEST for action security_group_rules [ 1065.913248] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGHEST for action security_group_members [ 1065.913343] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aead3f3b-f2f8-43d8-8761-7f291c9f3d34 with Priority: HIGHEST for action port [ 1065.913918] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-796dade6-def8-42b0-adbd-7347623ab0c8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.914059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.914130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.914334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.914417] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.915250] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-796dade6-def8-42b0-adbd-7347623ab0c8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.915368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.915434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.915601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.915748] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.915843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.915903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.916057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.916148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.916233] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.916972] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-aead3f3b-f2f8-43d8-8761-7f291c9f3d34 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.917796] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aead3f3b-f2f8-43d8-8761-7f291c9f3d34" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.917796] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aead3f3b-f2f8-43d8-8761-7f291c9f3d34" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.917796] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aead3f3b-f2f8-43d8-8761-7f291c9f3d34" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.917796] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aead3f3b-f2f8-43d8-8761-7f291c9f3d34',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.419216] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.423265] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-796dade6-def8-42b0-adbd-7347623ab0c8 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.423265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.423265] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aead3f3b-f2f8-43d8-8761-7f291c9f3d34 with status ACTIVE [ 1066.423265] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.423265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.423265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.423265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.423265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.423265] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.423265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.423265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.423265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.423265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.423265] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.423884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.423884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.423884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.423884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.423884] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aead3f3b-f2f8-43d8-8761-7f291c9f3d34 is going to be updated. [ 1066.447355] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.447503] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.447573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.447792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.447926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.448103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aead3f3b-f2f8-43d8-8761-7f291c9f3d34" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.926406] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.429788] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.430144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.431144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.431144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.431144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.431144] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 796dade6-def8-42b0-adbd-7347623ab0c8 is going to be created. [ 1067.456911] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.457081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.457158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.457367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.457527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.466382] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 796dade6-def8-42b0-adbd-7347623ab0c8 in Status: UNINITIALIZED for 2s [ 1068.930329] env[69491]: INFO networking_nsxv3.common.synchronization [req-d896cee3-e275-491b-ae2c-bc5d7acba747 req-a2aba26a-47ef-48b0-9974-6e8b25645ab3 tempest-MultipleCreateTestJSON-326272290 tempest-MultipleCreateTestJSON-326272290-project-member] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1068.930961] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1068.931302] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.931425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.931507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.931740] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.931899] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.933049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.933182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.933378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.933524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.933626] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.287423] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.287671] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.287759] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.288113] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.288464] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.288598] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.288724] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.289103] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.289266] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.289477] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.289596] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.289706] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.290339] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.290339] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.290339] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.290339] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.308801] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.308801] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1069.308801] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.308801] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.309111] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-dcdc079f-06a8-44f2-9b3d-003d3ba3e58d taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.309295] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-dcdc079f-06a8-44f2-9b3d-003d3ba3e58d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.309425] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-dcdc079f-06a8-44f2-9b3d-003d3ba3e58d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.309752] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-dcdc079f-06a8-44f2-9b3d-003d3ba3e58d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.309897] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcdc079f-06a8-44f2-9b3d-003d3ba3e58d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.436230] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.436424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.436523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.436786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.436896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.437158] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.437284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.437374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.437542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.437645] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.437741] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 already deleted. [ 1069.437848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.477535] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 796dade6-def8-42b0-adbd-7347623ab0c8 in Status: SUCCESS [ 1069.477535] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.477535] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.477718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.477918] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.478060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.478183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.478302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.478386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.478473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.478562] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.812303] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.812547] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.812683] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.812973] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.813177] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.813343] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port dcdc079f-06a8-44f2-9b3d-003d3ba3e58d not found, creating... [ 1069.813652] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.813825] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.813950] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.814211] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.814363] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.814659] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.814840] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.814969] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.815206] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.815375] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.815528] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: dcdc079f-06a8-44f2-9b3d-003d3ba3e58d is going to be created. [ 1069.837356] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.837571] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.837703] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.837991] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.838755] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.838755] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-dcdc079f-06a8-44f2-9b3d-003d3ba3e58d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.984272] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.488710] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 796dade6-def8-42b0-adbd-7347623ab0c8: rpc.has_security_group_logging(os_id): False [ 1070.510851] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.511040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.511100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.511358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.511446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.511734] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.511848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.511914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.512083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.512241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.512343] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 796dade6-def8-42b0-adbd-7347623ab0c8 is going to be created. [ 1070.578459] env[69491]: INFO networking_nsxv3.common.synchronization [req-d896cee3-e275-491b-ae2c-bc5d7acba747 req-da422adc-e0a5-4205-9f66-1e10f2524d1c service nova] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_rules [ 1070.578804] env[69491]: INFO networking_nsxv3.common.synchronization [req-d896cee3-e275-491b-ae2c-bc5d7acba747 req-da422adc-e0a5-4205-9f66-1e10f2524d1c service nova] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1070.578865] env[69491]: INFO networking_nsxv3.common.synchronization [req-d896cee3-e275-491b-ae2c-bc5d7acba747 req-da422adc-e0a5-4205-9f66-1e10f2524d1c service nova] Enqueued Resource ID: dcdc079f-06a8-44f2-9b3d-003d3ba3e58d with Priority: HIGHEST for action port [ 1070.580890] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.581076] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.581137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.581352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.581561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.583230] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_rules [ 1070.583385] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1070.583485] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcdc079f-06a8-44f2-9b3d-003d3ba3e58d with Priority: HIGHEST for action port [ 1070.583790] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.584407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.584492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.584766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.584843] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.586263] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.586263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.586263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.586263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.586527] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.586527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.586527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.586781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.586781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.586781] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.590029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcdc079f-06a8-44f2-9b3d-003d3ba3e58d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.590029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcdc079f-06a8-44f2-9b3d-003d3ba3e58d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.590029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcdc079f-06a8-44f2-9b3d-003d3ba3e58d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.590029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcdc079f-06a8-44f2-9b3d-003d3ba3e58d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.590029] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcdc079f-06a8-44f2-9b3d-003d3ba3e58d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.602123] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 796dade6-def8-42b0-adbd-7347623ab0c8 in Status: IN_PROGRESS for 2s [ 1071.091266] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.092587] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.092587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.092754] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcdc079f-06a8-44f2-9b3d-003d3ba3e58d with status ACTIVE [ 1071.092883] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.092991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.093064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.093266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.093352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.093525] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.093673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.093673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.094132] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.094132] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.094132] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.094279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.094279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.094380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.094444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.094528] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcdc079f-06a8-44f2-9b3d-003d3ba3e58d is going to be updated. [ 1071.116932] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.117171] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.117315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.117573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.117810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.118027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcdc079f-06a8-44f2-9b3d-003d3ba3e58d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.410911] env[69491]: INFO networking_nsxv3.common.synchronization [req-d896cee3-e275-491b-ae2c-bc5d7acba747 req-849c3479-d90f-45b3-9ade-ec220d92534e tempest-MultipleCreateTestJSON-326272290 tempest-MultipleCreateTestJSON-326272290-project-member] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1071.411722] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1071.411900] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.412049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.596398] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.708516] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.708719] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.708851] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.709148] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.709409] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.709571] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.709921] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.710230] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.710401] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.710617] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1071.710738] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.710853] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.710969] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.711133] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1071.711272] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.711415] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.730860] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.731052] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1071.731230] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.731431] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.731783] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-42433754-568a-47c8-a901-190ced44a3dd taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.731965] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-42433754-568a-47c8-a901-190ced44a3dd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.732106] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-42433754-568a-47c8-a901-190ced44a3dd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.732533] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-42433754-568a-47c8-a901-190ced44a3dd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.732693] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42433754-568a-47c8-a901-190ced44a3dd',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.102311] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.102311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.102651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.102651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.102705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.102809] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be created. [ 1072.127152] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.127304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.127376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.127598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.127878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.139439] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: UNINITIALIZED for 2s [ 1072.234836] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.235060] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.235251] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.235597] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.235780] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.236041] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 42433754-568a-47c8-a901-190ced44a3dd not found, creating... [ 1072.236349] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.236586] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.236788] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.237067] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.237222] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.237633] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.237752] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.237896] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.238183] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.238462] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.238462] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 42433754-568a-47c8-a901-190ced44a3dd is going to be created. [ 1072.271023] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.271236] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.271366] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.271656] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.271895] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.272143] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-42433754-568a-47c8-a901-190ced44a3dd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.616159] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 796dade6-def8-42b0-adbd-7347623ab0c8 in Status: SUCCESS [ 1072.616479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.004334] env[69491]: INFO networking_nsxv3.common.synchronization [req-d896cee3-e275-491b-ae2c-bc5d7acba747 req-5af1b52f-d6d3-4dc2-a1a2-05b729154456 service nova] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_rules [ 1073.004334] env[69491]: INFO networking_nsxv3.common.synchronization [req-d896cee3-e275-491b-ae2c-bc5d7acba747 req-5af1b52f-d6d3-4dc2-a1a2-05b729154456 service nova] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1073.004334] env[69491]: INFO networking_nsxv3.common.synchronization [req-d896cee3-e275-491b-ae2c-bc5d7acba747 req-5af1b52f-d6d3-4dc2-a1a2-05b729154456 service nova] Enqueued Resource ID: 42433754-568a-47c8-a901-190ced44a3dd with Priority: HIGHEST for action port [ 1073.005286] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_rules [ 1073.005840] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1073.006084] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42433754-568a-47c8-a901-190ced44a3dd with Priority: HIGHEST for action port [ 1073.008031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.008031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.008031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.008031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.008031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-42433754-568a-47c8-a901-190ced44a3dd taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.008031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42433754-568a-47c8-a901-190ced44a3dd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.008031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42433754-568a-47c8-a901-190ced44a3dd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.008031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42433754-568a-47c8-a901-190ced44a3dd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.008031] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42433754-568a-47c8-a901-190ced44a3dd',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.510338] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42433754-568a-47c8-a901-190ced44a3dd with status ACTIVE [ 1073.510768] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.511226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.511298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.511527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.511630] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.511880] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.511995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.511995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.512158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.512232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.512416] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.512515] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.512575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.512708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.512783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.512863] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42433754-568a-47c8-a901-190ced44a3dd is going to be updated. [ 1073.535063] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.535218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.535289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.535506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.535662] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.535816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42433754-568a-47c8-a901-190ced44a3dd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.974253] env[69491]: INFO networking_nsxv3.common.synchronization [req-04b20eb5-7271-4189-91cd-304c568017d8 req-ccbf2a33-9cae-4856-ba12-4d4cc0c9bf73 tempest-DeleteServersTestJSON-1018355336 tempest-DeleteServersTestJSON-1018355336-project-member] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1073.974669] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1073.975242] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.975352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.975390] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.975641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.975850] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.975915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.975952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.976122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.976210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.976305] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.149476] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: UNINITIALIZED for 4s [ 1074.308159] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.309170] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.309170] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.309427] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.309787] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.310693] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.310693] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.310693] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.310825] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.311014] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.311232] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.311313] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.311470] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.311614] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.311774] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.311933] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.333984] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.334333] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1074.334553] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.334801] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.335356] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-d2f316fc-51a9-4521-b5db-ca0fb4dac30a taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.335511] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-d2f316fc-51a9-4521-b5db-ca0fb4dac30a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.335691] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-d2f316fc-51a9-4521-b5db-ca0fb4dac30a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.336416] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-d2f316fc-51a9-4521-b5db-ca0fb4dac30a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.336629] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2f316fc-51a9-4521-b5db-ca0fb4dac30a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.478771] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.478927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.478999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.479232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.479321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.479518] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.479613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.479674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.480142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.480142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.480142] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d already deleted. [ 1074.480142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.839480] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.839782] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.839872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.840289] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.840693] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.840693] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port d2f316fc-51a9-4521-b5db-ca0fb4dac30a not found, creating... [ 1074.840917] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.841104] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.841230] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.841489] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.841634] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.841944] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.843335] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.843498] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.843760] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.843926] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.844138] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: d2f316fc-51a9-4521-b5db-ca0fb4dac30a is going to be created. [ 1074.867802] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.868100] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.868173] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.868572] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.868873] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.869129] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-d2f316fc-51a9-4521-b5db-ca0fb4dac30a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.802180] env[69491]: INFO networking_nsxv3.common.synchronization [req-04b20eb5-7271-4189-91cd-304c568017d8 req-ca87b63a-b70b-4823-a39a-c7d6260551d2 service nova] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_rules [ 1075.802440] env[69491]: INFO networking_nsxv3.common.synchronization [req-04b20eb5-7271-4189-91cd-304c568017d8 req-ca87b63a-b70b-4823-a39a-c7d6260551d2 service nova] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1075.802626] env[69491]: INFO networking_nsxv3.common.synchronization [req-04b20eb5-7271-4189-91cd-304c568017d8 req-ca87b63a-b70b-4823-a39a-c7d6260551d2 service nova] Enqueued Resource ID: d2f316fc-51a9-4521-b5db-ca0fb4dac30a with Priority: HIGHEST for action port [ 1075.803242] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_rules [ 1075.803377] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1075.803513] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2f316fc-51a9-4521-b5db-ca0fb4dac30a with Priority: HIGHEST for action port [ 1075.803857] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.803993] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.804083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.804383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.804471] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.805446] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.805573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.805645] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.805875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.806040] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.806167] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.806257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.806425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.806509] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.806626] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.807534] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2f316fc-51a9-4521-b5db-ca0fb4dac30a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.807628] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2f316fc-51a9-4521-b5db-ca0fb4dac30a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.807699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2f316fc-51a9-4521-b5db-ca0fb4dac30a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.807859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2f316fc-51a9-4521-b5db-ca0fb4dac30a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.807958] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2f316fc-51a9-4521-b5db-ca0fb4dac30a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.160888] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: SUCCESS [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.165379] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.165379] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.165379] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.165379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.165379] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.311627] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.312348] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.312348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.312348] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2f316fc-51a9-4521-b5db-ca0fb4dac30a with status ACTIVE [ 1076.312564] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.312564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.312683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.312847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.312948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.313131] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.313213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.313249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.313491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.313491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.313654] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.313764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.313818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.313945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.314064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.314262] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2f316fc-51a9-4521-b5db-ca0fb4dac30a is going to be updated. [ 1076.337319] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.337319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.337554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.337611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.337747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.337928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2f316fc-51a9-4521-b5db-ca0fb4dac30a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.666687] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.666846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.667049] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.816967] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.083282] env[69491]: INFO networking_nsxv3.common.synchronization [req-64ff791f-cdf2-48fa-80b0-9c03ca28aac8 req-c9f5cde2-0e87-4b8a-be7e-db3390d5a91a tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1077.085757] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1077.085757] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.085757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.085757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.086230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.086230] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.086532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.086532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.086588] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.086753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.086753] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.091352] env[69491]: INFO networking_nsxv3.common.synchronization [req-410cafb6-507d-4e52-8946-0632afb18131 req-f2104be6-ee9a-4274-a2af-3d8344e10974 tempest-ImagesTestJSON-1178517317 tempest-ImagesTestJSON-1178517317-project-member] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 1077.092674] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGHEST for action security_group_members [ 1077.093135] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.093516] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.093570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.093776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.093932] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.094047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.094119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.094271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.094348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.094446] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.170165] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.319694] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.321183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.321183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.321183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.321183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.321183] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be created. [ 1077.350465] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.350634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.350701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.350919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.351101] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.364170] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: UNINITIALIZED for 2s [ 1077.505862] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.506092] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.506251] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.506574] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.506810] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.506977] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.507113] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.507353] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.507506] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.507724] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.507842] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.508042] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.508178] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.508301] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.508415] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.508555] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.529031] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.529217] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1077.529412] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.529639] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.530508] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-b1a8e065-7b93-4794-9d2f-be33cd898fab taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.530777] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-b1a8e065-7b93-4794-9d2f-be33cd898fab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.530888] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-b1a8e065-7b93-4794-9d2f-be33cd898fab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.531493] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-b1a8e065-7b93-4794-9d2f-be33cd898fab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.531493] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a8e065-7b93-4794-9d2f-be33cd898fab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.593428] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.597161] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.597325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.597416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.597631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.597721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.597974] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.598129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.598214] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.598383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.598464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.598555] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be updated. [ 1077.629152] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.629401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.629401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.629660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.629857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.639773] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: IN_PROGRESS for 2s [ 1077.674181] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.674181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.674181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.674181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.674181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.674464] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be updated. [ 1077.701449] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.701698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.701799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.702036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.702188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.713537] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: IN_PROGRESS for 2s [ 1078.034385] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.034626] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.034767] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.035096] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.035273] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.035439] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port b1a8e065-7b93-4794-9d2f-be33cd898fab not found, creating... [ 1078.035706] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.035878] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.036009] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.036247] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.036394] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.036684] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.036850] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.036976] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.037239] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.037378] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.037545] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: b1a8e065-7b93-4794-9d2f-be33cd898fab is going to be created. [ 1078.062063] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.062310] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.062409] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.062692] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.062934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.063211] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-b1a8e065-7b93-4794-9d2f-be33cd898fab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.096065] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.598919] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.599192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.599192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.599658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.599658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.599658] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1078.636382] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.636714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.636714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.637415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.638699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.650715] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1078.762769] env[69491]: INFO networking_nsxv3.common.synchronization [req-64ff791f-cdf2-48fa-80b0-9c03ca28aac8 req-d291b377-2e35-4c4d-882f-be644e318dc3 service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 1078.762952] env[69491]: INFO networking_nsxv3.common.synchronization [req-64ff791f-cdf2-48fa-80b0-9c03ca28aac8 req-d291b377-2e35-4c4d-882f-be644e318dc3 service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1078.763130] env[69491]: INFO networking_nsxv3.common.synchronization [req-64ff791f-cdf2-48fa-80b0-9c03ca28aac8 req-d291b377-2e35-4c4d-882f-be644e318dc3 service nova] Enqueued Resource ID: b1a8e065-7b93-4794-9d2f-be33cd898fab with Priority: HIGHEST for action port [ 1078.764639] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 1078.764765] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1078.764872] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a8e065-7b93-4794-9d2f-be33cd898fab with Priority: HIGHEST for action port [ 1078.765506] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.765641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.765712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.765908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.765991] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.767275] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.767408] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.767664] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1a8e065-7b93-4794-9d2f-be33cd898fab taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.767775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1a8e065-7b93-4794-9d2f-be33cd898fab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.767841] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1a8e065-7b93-4794-9d2f-be33cd898fab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.768071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1a8e065-7b93-4794-9d2f-be33cd898fab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.768158] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a8e065-7b93-4794-9d2f-be33cd898fab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.270469] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.270692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.273047] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1a8e065-7b93-4794-9d2f-be33cd898fab with status ACTIVE [ 1079.273272] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.273402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.273473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.273690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.273783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.274036] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.274147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.274213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.274372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.274452] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.274633] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.274726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.274788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.274929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.275014] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.275104] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1a8e065-7b93-4794-9d2f-be33cd898fab is going to be updated. [ 1079.301222] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.301222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.301222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.301222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.301222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.301222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1a8e065-7b93-4794-9d2f-be33cd898fab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.377906] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1079.378186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.378368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.378596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.378800] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.378994] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.378994] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.379157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.379341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.379341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.379481] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.602326] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.602326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.602326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.602326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.602326] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.612224] env[69491]: INFO networking_nsxv3.common.synchronization [req-b2e1e370-8a7d-40d9-88ce-9c5238d64173 req-990d71a6-ac5c-4ed4-a2ab-77552a4061dd tempest-ServersNegativeTestJSON-337259715 tempest-ServersNegativeTestJSON-337259715-project-member] Enqueued Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 1079.612224] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGHEST for action security_group_members [ 1079.612224] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.612224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.612224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.612773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.613114] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.613391] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.613614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.614134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.616221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.616221] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.651645] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9028d23d-9b03-48da-a060-d720486e9412 in Status: SUCCESS [ 1079.652137] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9028d23d-9b03-48da-a060-d720486e9412 deletion is rescheduled due to dependency. [ 1079.652546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.723932] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: SUCCESS [ 1079.724813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.725270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.725270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.725466] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.725589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.725660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.725819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.726264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.726371] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.882036] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.882226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.882262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.883037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.883037] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.883037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.883037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.883037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.883037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.883562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.883562] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.883562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.883562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.883562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.883805] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.883805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.883805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.883959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.884023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.884092] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.884186] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.104007] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.117642] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.117806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.117896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.118164] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.118352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.118454] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.118532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.118716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.118716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.118780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.118873] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 is going to be updated. [ 1080.146520] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.146682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.146729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.146939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.147117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.157288] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: IN_PROGRESS for 2s [ 1080.228943] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.389385] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d: rpc.has_security_group_logging(os_id): False [ 1080.410982] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.411198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.411198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.411405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.411499] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.411761] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.411864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.411937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.412122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.412256] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.412724] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.412724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.412724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.412899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.412980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.413217] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.413342] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.413408] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.413553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.413657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.413784] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be created. [ 1080.481789] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.481950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.482038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.482250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.482427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.494225] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1080.607340] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.663348] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1080.663348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.663348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.663348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.663636] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.663729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.663841] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.664148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.664255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.664387] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.732070] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.110548] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1081.110548] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1081.166495] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.234565] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.234867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.234867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.235146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.235248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.235362] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be updated. [ 1081.264661] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.264992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.264992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.265234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.265327] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.275673] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: IN_PROGRESS for 2s [ 1081.669250] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.061276] env[69491]: INFO networking_nsxv3.common.synchronization [req-4cfd6698-1d45-4e40-b4bf-dc4b43272956 req-74dbe0e1-10c9-420c-aee9-40cac2103ba6 tempest-ServerDiskConfigTestJSON-964931906 tempest-ServerDiskConfigTestJSON-964931906-project-member] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 1082.061276] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 1082.061276] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.061476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.061596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.061834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.062074] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.062238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.062326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.062537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.062651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.062827] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.167637] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.167997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.168131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.168562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.182405] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1082.183394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.184950] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1082.186464] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.186604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.186604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.186817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.186957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.187087] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1082.188907] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fafd77cc-d50d-41af-b588-6629e9cea514 in Status: SUCCESS [ 1082.189956] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 deletion is rescheduled due to dependency. [ 1082.190088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.246024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.246024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.246024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.246024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.246024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.249671] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.250426] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.250534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.250772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.263214] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.265031] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1082.265031] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1082.265031] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1082.278723] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1082.321799] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.322097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.322228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.322462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.324095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.324192] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1082.422845] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.422993] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.423082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.423301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.423716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.424220] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1082.508676] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1082.508927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.517939] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.518189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.518189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.518384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.518671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.518977] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1082.519077] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'796dade6-def8-42b0-adbd-7347623ab0c8', 'fafd77cc-d50d-41af-b588-6629e9cea514', '21ffc58d-ad1f-4978-9447-c2859da9a03e', '62c4aff5-ba77-43c8-9eb6-a56da143180b', '415ca665-bf4f-490e-98cb-4ba509031109', '06871947-bfe0-4792-9f13-39942cbccdf7', 'ebfca2b7-f089-437e-979a-24f210590561', 'bdef2989-64ee-40c2-bd6c-f47c52643b88', 'ab7773f0-7815-4a45-bf15-8a8079aa86ff', '5f7c8116-1800-43a9-8bbf-52caccb697c1', 'f14cf56d-2a11-4dcf-9f65-92e04445741f', '9632268c-db1a-4548-9652-b638bc84b886', 'd4084412-2aca-4bc0-a15c-1690668e51ea', '53902bde-30e4-44b3-9472-853fecdeacca', 'd029d7dd-2e40-4077-9e65-c77ae878eeb1', '6fd20800-5a4b-495c-a02a-35b10f00ea55', 'de4976ed-85d7-4836-b6cb-a96b2293c655', '41c677ae-81d2-401f-823f-258d2ebc4afc', '36f74a30-d3ec-48c5-8573-1f7852cad1f9', '00540613-7092-4498-a250-9bb6d721591a', 'a17d719d-b50f-4937-8fa1-f7b3109414a1', '8d5a33a2-cab9-4479-9d1c-125f032b265a', 'ab8f0b03-5851-4bc3-a9e8-aba2b5714126', '88118802-dd47-4c99-a6fd-7180a306f792', 'a783226f-a1df-4921-a642-6c211f5f8022', 'c9023993-36fc-47c8-9c97-1eea2e87c7cf', '337bf73b-206c-43a7-940b-8771364a9da6', 'd226f0cc-ed68-4bbb-a45f-f167f2ea29ab', 'eaa139e8-f09f-4a46-897a-d481019a63be', 'f5d9b441-54c3-4ef0-8866-aee0f17f0fb9', '9028d23d-9b03-48da-a060-d720486e9412', '1174b667-c607-4471-b059-900f8b5c4de2', '57178755-8937-4ec8-907c-6e349b3947d2', '556224b2-1959-4315-89ac-879f1d706247', '491f4d82-845e-4e02-b3d7-2b5c77772eb6', '96abde26-4f7d-4753-9d4c-ed85ae0b31bf', '6f1845a9-2c44-4df3-b2c4-babd12fe1f1d', '2718fb34-4e94-4380-bd09-5b025d3b2125', '8c9d4b0f-923e-4454-badc-cbd5c63e211f', 'd394eeb6-7de4-4a71-8d79-c137cc55ad50', '4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017', '8c5808a0-5aae-42f0-89ec-a7d1d00bc588', '71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f', 'f1812f0f-128b-41f6-987e-18e589d1ef41', 'c01fe6e7-4574-4c6a-973e-552160230574', '745f6209-d9d3-480b-9445-604b9585bfe0', '5f6ef41a-5e03-4f6b-8b59-b1f729f165d1'} {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1082.519224] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1082.538496] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.538664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.538719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.538937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.539038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.539150] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1082.539224] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1082.539298] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1082.566019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.566216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.566300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.566524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.589162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.589458] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.589582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.589651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.589908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.590102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.590102] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 1082.619591] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.619758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.619920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.620097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.620267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.631370] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 1082.640319] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.640646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.640646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.640646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.643042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.643042] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1082.643042] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1082.643042] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1082.643042] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1082.643042] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1082.643042] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGH for action security_group_rules [ 1082.643042] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGH for action security_group_rules [ 1082.643042] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e with Priority: HIGH for action security_group_rules [ 1082.643042] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGH for action security_group_rules [ 1082.643042] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGH for action security_group_rules [ 1082.643042] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGH for action security_group_rules [ 1082.643042] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGH for action security_group_rules [ 1082.643615] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGH for action security_group_rules [ 1082.643615] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGH for action security_group_rules [ 1082.643615] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 with Priority: HIGH for action security_group_rules [ 1082.643615] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f14cf56d-2a11-4dcf-9f65-92e04445741f with Priority: HIGH for action security_group_rules [ 1082.643615] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGH for action security_group_rules [ 1082.643615] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGH for action security_group_rules [ 1082.643615] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGH for action security_group_rules [ 1082.643615] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGH for action security_group_rules [ 1082.643615] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGH for action security_group_rules [ 1082.643615] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGH for action security_group_rules [ 1082.643906] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGH for action security_group_rules [ 1082.643906] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 with Priority: HIGH for action security_group_rules [ 1082.643906] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGH for action security_group_rules [ 1082.643906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.293199] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: SUCCESS [ 1083.293789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.293789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.293884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.294039] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.294169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.294272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.294412] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.294493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.294604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.294810] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.294923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.294923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.295078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.295190] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.295284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.295343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.295480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.295556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.295635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.295723] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.797806] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e040c3ad-864e-4a08-8074-d3b87c80b2c3: rpc.has_security_group_logging(os_id): False [ 1083.816425] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.816580] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.816651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.816869] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.816957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.817153] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.817260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.817323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.817472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.817546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.817847] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.817955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.818030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.818203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.818282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.818464] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.818556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.818616] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.818753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.818824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.818911] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be created. [ 1083.883747] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.883747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.883747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.883747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.883747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.894916] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: IN_PROGRESS for 2s [ 1083.906182] env[69491]: INFO networking_nsxv3.common.synchronization [req-0b2513a7-9a59-4053-acb2-4f0749cc18dd req-8d7e0b9f-fd6f-4ed3-935a-890a7f7340d0 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_members [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_members [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00540613-7092-4498-a250-9bb6d721591a with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4976ed-85d7-4836-b6cb-a96b2293c655 with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53902bde-30e4-44b3-9472-853fecdeacca with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4084412-2aca-4bc0-a15c-1690668e51ea with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f14cf56d-2a11-4dcf-9f65-92e04445741f with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 with Priority: HIGH for action security_group_rules [ 1083.908303] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGH for action security_group_rules [ 1083.910629] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06871947-bfe0-4792-9f13-39942cbccdf7 with Priority: HIGH for action security_group_rules [ 1083.910629] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 with Priority: HIGH for action security_group_rules [ 1083.910629] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415ca665-bf4f-490e-98cb-4ba509031109 with Priority: HIGH for action security_group_rules [ 1083.910629] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafd77cc-d50d-41af-b588-6629e9cea514 with Priority: HIGH for action security_group_rules [ 1083.910629] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b with Priority: HIGH for action security_group_rules [ 1083.910629] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.910629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.910629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.910629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.910629] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.910629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.910629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.910629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.910629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.910629] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.911652] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-796dade6-def8-42b0-adbd-7347623ab0c8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.911767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.911837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.913213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.913213] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.913213] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21ffc58d-ad1f-4978-9447-c2859da9a03e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.913213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.913213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.913213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.913519] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21ffc58d-ad1f-4978-9447-c2859da9a03e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.914201] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.914316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.914384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.914741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.914821] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.915501] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.915611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.915672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.915826] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.916094] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d029d7dd-2e40-4077-9e65-c77ae878eeb1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.916912] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00540613-7092-4498-a250-9bb6d721591a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.917029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.917089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.917366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.917444] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00540613-7092-4498-a250-9bb6d721591a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.918139] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36f74a30-d3ec-48c5-8573-1f7852cad1f9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.918250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.918299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.918627] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.922027] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36f74a30-d3ec-48c5-8573-1f7852cad1f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.922027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.922027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.922027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.922027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.922027] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.922027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de4976ed-85d7-4836-b6cb-a96b2293c655 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.922027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.922027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.922027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.922027] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de4976ed-85d7-4836-b6cb-a96b2293c655',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.922948] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53902bde-30e4-44b3-9472-853fecdeacca taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.922948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.922948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.922948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.922948] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53902bde-30e4-44b3-9472-853fecdeacca',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.923421] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.923537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.923754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.923911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.923979] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.924856] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4084412-2aca-4bc0-a15c-1690668e51ea taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.924856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.924856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.925017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.925017] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4084412-2aca-4bc0-a15c-1690668e51ea',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.925757] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.926105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.926198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.926375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.926450] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.927122] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f14cf56d-2a11-4dcf-9f65-92e04445741f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.927370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.927444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.927615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.927683] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f14cf56d-2a11-4dcf-9f65-92e04445741f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.928361] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f7c8116-1800-43a9-8bbf-52caccb697c1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.928456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.928510] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.928655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.928722] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f7c8116-1800-43a9-8bbf-52caccb697c1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.929402] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.929494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.929549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.929707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.929761] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.930554] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06871947-bfe0-4792-9f13-39942cbccdf7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.930660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.930720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.930879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.931092] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06871947-bfe0-4792-9f13-39942cbccdf7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.934154] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdef2989-64ee-40c2-bd6c-f47c52643b88 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.934154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.934154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.934154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.934154] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdef2989-64ee-40c2-bd6c-f47c52643b88',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.934154] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-415ca665-bf4f-490e-98cb-4ba509031109 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.934154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.934154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.934154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.934154] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('415ca665-bf4f-490e-98cb-4ba509031109',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.934705] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fafd77cc-d50d-41af-b588-6629e9cea514 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.934917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.934917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.935041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.935081] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fafd77cc-d50d-41af-b588-6629e9cea514',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.935997] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62c4aff5-ba77-43c8-9eb6-a56da143180b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.936124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.936165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.936317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.936384] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62c4aff5-ba77-43c8-9eb6-a56da143180b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.290236] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1084.290472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.290648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.291059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.291130] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.291196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.291257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.291402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.291480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.291562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.291653] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.443571] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.443883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.443883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.445167] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.446524] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.448228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.448315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.448582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.448705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.448807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.448901] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.451422] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-796dade6-def8-42b0-adbd-7347623ab0c8 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.453334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.453334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.453334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.453334] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.453334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.453334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.453334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.453334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.453334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.453334] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.453783] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.453783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.453783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.453783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.454222] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.454222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.454222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.454222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.454443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.454443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.454443] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.458555] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.458694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.458733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.462140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.462140] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.462140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.462140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.462140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.462140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.462140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.462140] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.464753] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.464753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.464753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.465151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.465151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.465216] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.465270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.465320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.465486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.465534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.465617] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 already deleted. [ 1084.465693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.513409] env[69491]: INFO networking_nsxv3.common.synchronization [req-777bb34e-539a-445f-babb-4122f30d12e8 req-762c0036-c0ae-4c12-b9ab-4cc6b455993e tempest-MultipleCreateTestJSON-326272290 tempest-MultipleCreateTestJSON-326272290-project-member] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1084.519959] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1084.521432] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.521596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.521673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.521894] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.522082] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.522651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.522651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.522651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.522651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.522651] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.536012] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.536683] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.536683] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.536955] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.537285] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.537480] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.537681] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.537975] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.538211] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.538418] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1084.539029] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1084.539029] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1084.539029] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1084.539029] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1084.539029] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1084.539374] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1084.550932] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.551146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.551788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.551788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.555559] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.555559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.557822] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.557822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.558918] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.559020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.560057] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.560057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.560837] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.560977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.561973] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.561973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.563913] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.564055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.564813] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.564915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.565573] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.566169] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.567646] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.567646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.567646] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1084.567927] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.568049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.568743] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1084.569240] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.569351] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.569610] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1084.570157] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.570295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.572128] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1084.572128] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.572128] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.572296] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1084.572736] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.572899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.582772] env[69491]: WARNING urllib3.connectionpool [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1084.583420] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1084.583581] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1084.583721] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1084.584114] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.584497] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-b0420c88-0777-4811-a2bb-1bdc927df5ae taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.584739] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-b0420c88-0777-4811-a2bb-1bdc927df5ae" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.584825] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-b0420c88-0777-4811-a2bb-1bdc927df5ae" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.585188] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-b0420c88-0777-4811-a2bb-1bdc927df5ae" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.585447] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0420c88-0777-4811-a2bb-1bdc927df5ae',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.587205] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1084.587865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.587992] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21ffc58d-ad1f-4978-9447-c2859da9a03e is going to be deleted. [ 1084.589099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.589342] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.615356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.615679] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62c4aff5-ba77-43c8-9eb6-a56da143180b is going to be deleted. [ 1084.617018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.617376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.640995] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 1084.641211] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff deletion is rescheduled due to dependency. [ 1084.641339] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.642515] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.642635] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be deleted. [ 1084.645317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.645626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.665996] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.666126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.680171] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.680404] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36f74a30-d3ec-48c5-8573-1f7852cad1f9 is going to be deleted. [ 1084.681543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.681743] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.702286] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.702520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.706487] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.706828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.708345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.708345] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de4976ed-85d7-4836-b6cb-a96b2293c655 is going to be deleted. [ 1084.709425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.709653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.796466] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.796657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.796717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.796922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.797114] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.797230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.797294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.797442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.797532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.797627] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.797786] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.797888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.797949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.798119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.798259] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.798349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.798409] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.798544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.798619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.798699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.798790] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.816799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.816934] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06871947-bfe0-4792-9f13-39942cbccdf7 is going to be deleted. [ 1084.817878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.818117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.818208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.818320] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be deleted. [ 1084.819141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.819338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.838059] env[69491]: INFO networking_nsxv3.common.synchronization [req-27bb4268-8fb0-47a1-affc-a1fefb9c995f req-6a6f77be-334d-4b42-a3ee-d2588bb974c6 tempest-MultipleCreateTestJSON-326272290 tempest-MultipleCreateTestJSON-326272290-project-member] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1084.838599] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1084.839430] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.839548] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.906520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.906690] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00540613-7092-4498-a250-9bb6d721591a is going to be deleted. [ 1084.907631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.907919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.920363] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.920496] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.969455] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.969623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.969681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.969973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.970140] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.970322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.970322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.970453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.970547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.970648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.970825] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.970921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.970978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.971139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.971275] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.971366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.971426] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.971562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.971635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.971714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.971801] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.972747] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.973495] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.975806] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.986462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.986601] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415ca665-bf4f-490e-98cb-4ba509031109 is going to be deleted. [ 1084.987798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.988058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.990032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.990140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.991549] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.991702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.995970] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.996085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.015528] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.015673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.018574] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.018703] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d029d7dd-2e40-4077-9e65-c77ae878eeb1 is going to be deleted. [ 1085.019621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.019916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.026933] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.050633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.050822] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdef2989-64ee-40c2-bd6c-f47c52643b88 is going to be deleted. [ 1085.052514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.052763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.091585] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.091834] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.091995] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.092338] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.092515] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.092722] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port b0420c88-0777-4811-a2bb-1bdc927df5ae not found, creating... [ 1085.093018] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.093190] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.093537] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.093824] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.093983] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.094356] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.094527] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.094650] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.094887] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.095043] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.095195] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: b0420c88-0777-4811-a2bb-1bdc927df5ae is going to be created. [ 1085.112122] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.112319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.155259] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.155404] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.156401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.156601] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f14cf56d-2a11-4dcf-9f65-92e04445741f is going to be deleted. [ 1085.157436] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.157658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.159393] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.159600] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.159774] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.160072] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.160311] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.160536] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-b0420c88-0777-4811-a2bb-1bdc927df5ae" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.255195] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.255354] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f7c8116-1800-43a9-8bbf-52caccb697c1 is going to be deleted. [ 1085.256352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.256596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.302140] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d394eeb6-7de4-4a71-8d79-c137cc55ad50: rpc.has_security_group_logging(os_id): False [ 1085.311408] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.311408] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.316034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.316034] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fafd77cc-d50d-41af-b588-6629e9cea514 is going to be deleted. [ 1085.316531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.316697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.363565] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.363694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.396468] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.396666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.420410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.420410] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4084412-2aca-4bc0-a15c-1690668e51ea is going to be deleted. [ 1085.420410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.420843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.424158] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.424158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.462267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.462613] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53902bde-30e4-44b3-9472-853fecdeacca is going to be deleted. [ 1085.463556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.463801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.463899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.464050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21ffc58d-ad1f-4978-9447-c2859da9a03e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.464224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.464410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.464495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.464618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62c4aff5-ba77-43c8-9eb6-a56da143180b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.465195] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.465371] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.465455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.465585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.465732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.465881] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.465958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.466084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36f74a30-d3ec-48c5-8573-1f7852cad1f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.466213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.466364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.466440] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.466555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06871947-bfe0-4792-9f13-39942cbccdf7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.466682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.466823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.466900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.467022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de4976ed-85d7-4836-b6cb-a96b2293c655" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.467152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.467542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.467662] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.467745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.467882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.468043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.468313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.468313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00540613-7092-4498-a250-9bb6d721591a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.468377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.468492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.468566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.468676] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-415ca665-bf4f-490e-98cb-4ba509031109" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.468805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.468944] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.469025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.469138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d029d7dd-2e40-4077-9e65-c77ae878eeb1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.469264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.469417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.469470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.469617] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdef2989-64ee-40c2-bd6c-f47c52643b88" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.469705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.469946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.470054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.470148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f14cf56d-2a11-4dcf-9f65-92e04445741f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.470276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.470462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.476426] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41c677ae-81d2-401f-823f-258d2ebc4afc: rpc.has_security_group_logging(os_id): False [ 1085.477656] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebfca2b7-f089-437e-979a-24f210590561: rpc.has_security_group_logging(os_id): False [ 1085.478527] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 796dade6-def8-42b0-adbd-7347623ab0c8: rpc.has_security_group_logging(os_id): False [ 1085.479318] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fd20800-5a4b-495c-a02a-35b10f00ea55: rpc.has_security_group_logging(os_id): False [ 1085.497811] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.498012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.529514] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.567773] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.567991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.568803] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.568905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.569627] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.569985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.573734] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.573897] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.578251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.578512] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.578633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.578694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.578936] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.579043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.579246] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.579345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.579407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.579553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.579870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.579870] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.579963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.579963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.580176] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.580270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.580368] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1085.581546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.581715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.581803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.582322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f7c8116-1800-43a9-8bbf-52caccb697c1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.582507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.582843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.583183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.583300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fafd77cc-d50d-41af-b588-6629e9cea514" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.583501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.583682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.619793] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.620100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.627789] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.627789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.635326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.636110] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.637130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.637248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.637653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.638010] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.638319] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.638444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.638515] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.638771] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.638809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.639052] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.639145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.639209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.639365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.639443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.639547] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 1085.640810] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.640986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.685850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.686215] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.686326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.686395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.686601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.686685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.686784] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc is going to be updated. [ 1085.689441] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.689668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.764224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.764561] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.764670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.764737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.764934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.765027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.765149] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 796dade6-def8-42b0-adbd-7347623ab0c8 is going to be updated. [ 1085.766321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.766513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.766598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.766804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4084412-2aca-4bc0-a15c-1690668e51ea" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.766846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.766995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.807990] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.808174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.817274] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.817435] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.821159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.821159] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.821159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.821159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.821159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.821159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.821159] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 1085.821864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.822589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.822681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.822828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53902bde-30e4-44b3-9472-853fecdeacca" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.822993] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.823160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.823303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.825428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.825428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.825513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.834375] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.834515] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.834591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.834798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.834947] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.848201] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1085.849181] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 1085.856570] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: IN_PROGRESS for 2s [ 1085.915450] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: SUCCESS [ 1085.916591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.916591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.916591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.916591] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.922758] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.922904] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.922978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.923343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.923425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.932477] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.932705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.932796] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.933117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.933232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.966280] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 796dade6-def8-42b0-adbd-7347623ab0c8 in Status: IN_PROGRESS for 2s [ 1085.967624] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 1086.032434] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.032634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.032713] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.032901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.032989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.033105] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be updated. [ 1086.078316] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.078479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.078585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.078762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.078907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.090265] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: IN_PROGRESS for 2s [ 1086.437060] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.437295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.437380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.437561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.437671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.438056] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be deleted. [ 1086.487490] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.487827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.487827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.487955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.488066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.488215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.493329] env[69491]: INFO networking_nsxv3.common.synchronization [req-0b2513a7-9a59-4053-acb2-4f0749cc18dd req-d982b40f-4566-4968-bc36-043b0d13b864 service nova] Enqueued Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_rules [ 1086.493536] env[69491]: INFO networking_nsxv3.common.synchronization [req-0b2513a7-9a59-4053-acb2-4f0749cc18dd req-d982b40f-4566-4968-bc36-043b0d13b864 service nova] Enqueued Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_members [ 1086.493688] env[69491]: INFO networking_nsxv3.common.synchronization [req-0b2513a7-9a59-4053-acb2-4f0749cc18dd req-d982b40f-4566-4968-bc36-043b0d13b864 service nova] Enqueued Resource ID: b0420c88-0777-4811-a2bb-1bdc927df5ae with Priority: HIGHEST for action port [ 1086.493927] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_rules [ 1086.494089] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_members [ 1086.494247] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0420c88-0777-4811-a2bb-1bdc927df5ae with Priority: HIGHEST for action port [ 1086.494839] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.494999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.495555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.495835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.495922] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.497050] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.497050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.497050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.497237] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.497850] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.497978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.500187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.500187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.500187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.500187] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.500187] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0420c88-0777-4811-a2bb-1bdc927df5ae taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.500187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0420c88-0777-4811-a2bb-1bdc927df5ae" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.500187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0420c88-0777-4811-a2bb-1bdc927df5ae" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.501822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0420c88-0777-4811-a2bb-1bdc927df5ae" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.501912] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0420c88-0777-4811-a2bb-1bdc927df5ae',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.004592] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.004780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.004893] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.006221] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0420c88-0777-4811-a2bb-1bdc927df5ae with status ACTIVE [ 1087.006425] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.006549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.006623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.006836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.006926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.010272] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.010361] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.010398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.010575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.010664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.010867] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.010968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.011042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.011196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.011274] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.011362] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0420c88-0777-4811-a2bb-1bdc927df5ae is going to be updated. [ 1087.037735] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.037891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.037993] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.038269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.038551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.038748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0420c88-0777-4811-a2bb-1bdc927df5ae" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.514731] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.867539] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1087.867904] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.868975] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 1087.869170] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.870173] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: SUCCESS [ 1087.870378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.981060] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 1087.981060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.981060] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 796dade6-def8-42b0-adbd-7347623ab0c8 in Status: SUCCESS [ 1087.981060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.019766] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.019766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.019766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.019766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.019766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.019766] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 is going to be created. [ 1088.045977] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.045977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.045977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.045977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.045977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.054423] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: UNINITIALIZED for 2s [ 1088.100896] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: SUCCESS [ 1088.100896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.100896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.100896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.100896] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.101307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.101551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.101789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.101964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.102377] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.509707] env[69491]: INFO networking_nsxv3.common.synchronization [req-56bcc29e-e504-44e3-94ce-5231dec881de req-3f2c92a5-3ad9-4745-8281-b148c511658e tempest-DeleteServersTestJSON-1018355336 tempest-DeleteServersTestJSON-1018355336-project-member] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1088.513021] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1088.513021] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.513021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.513021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.513021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.513021] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.513408] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.513408] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.513523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.513602] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.513697] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.609906] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.609906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.609906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.609906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.609906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.609906] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.609906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.609906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.609906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.609906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.609906] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be deleted. [ 1088.640868] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.640868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.640868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.640868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.640868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.640868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.016018] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.016212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.016285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.016506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.040288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.040288] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.040510] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.040510] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.040634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.040724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.040815] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1089.069801] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.069983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.070065] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.070278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.070442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.079420] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1089.783872] env[69491]: INFO networking_nsxv3.common.synchronization [req-c3166685-9500-492a-a74a-aa7dd96c01eb req-8597e2d8-a484-466a-8221-a2a4b9ced7c5 tempest-ServerRescueNegativeTestJSON-1517573171 tempest-ServerRescueNegativeTestJSON-1517573171-project-member] Enqueued Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_members [ 1089.785133] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_members [ 1089.785233] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.785366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.785523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.785732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.786324] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.786324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.786324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.786324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.786563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.786563] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.066052] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: SUCCESS [ 1090.066052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.066052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.066052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.066052] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.066052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.066052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.066052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.066052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.066052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.066052] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.291202] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.570096] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.570314] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.570365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.571166] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.571373] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.571492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.571564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.571811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.571959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.572130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.572231] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.572327] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.572423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.572620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.572805] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.572921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.572989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.574997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.574997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.574997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.574997] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.677806] env[69491]: INFO networking_nsxv3.common.synchronization [req-0fd87ad6-5323-41f4-bdc6-aceccf3576b4 req-3aeee023-afd9-43ed-9bf2-d490fb98a307 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_members [ 1090.678603] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_members [ 1090.678992] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.679168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.679255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.679488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.680049] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.680049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.680049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.681705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.682080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.682153] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.793991] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.077511] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbb08221-1c71-4b91-a7dd-598e8bbc7914: rpc.has_security_group_logging(os_id): False [ 1091.089312] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1091.089705] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d deletion is rescheduled due to dependency. [ 1091.089705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.099200] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.099410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.099410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.099674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.099856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.099997] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.100104] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.100179] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.100325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.100400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.100597] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.100837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.100837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.101035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.101118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.101332] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.101453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.101513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.101657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.101753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.101950] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 is going to be created. [ 1091.180762] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.180973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.180973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.181164] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.181342] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.185050] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.191340] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: IN_PROGRESS for 2s [ 1091.271020] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.271020] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.272107] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.272107] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.272107] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.272364] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.272364] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.272562] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.272724] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.272949] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.273082] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.273199] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.273315] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.273512] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.273603] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.273752] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.298797] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.298797] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.298797] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.298797] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.298797] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-575c40a4-d799-474b-b70e-ef13d4457a89 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.299156] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-575c40a4-d799-474b-b70e-ef13d4457a89" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.299477] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-575c40a4-d799-474b-b70e-ef13d4457a89" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.300198] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-575c40a4-d799-474b-b70e-ef13d4457a89" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.300437] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('575c40a4-d799-474b-b70e-ef13d4457a89',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.301686] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.301836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.301905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.302133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.302234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.302345] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88118802-dd47-4c99-a6fd-7180a306f792 is going to be updated. [ 1091.364961] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.365135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.365209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.365431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.365578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.376575] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: IN_PROGRESS for 2s [ 1091.689594] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.719747] env[69491]: INFO networking_nsxv3.common.synchronization [req-206af58b-4655-4d5d-990d-a157de8d457d req-207574be-29ea-470b-afa3-33f3b96dc0b0 tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1091.720751] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1091.720751] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.720751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.720751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.721040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.721075] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.721199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.721276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.721467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.721640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.721752] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.805172] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.805478] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.806707] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.808227] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.808227] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.808227] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 575c40a4-d799-474b-b70e-ef13d4457a89 not found, creating... [ 1091.808227] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.808227] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.808227] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.808227] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.808453] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.808654] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.808815] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.809719] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.809978] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.810157] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.810326] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 575c40a4-d799-474b-b70e-ef13d4457a89 is going to be created. [ 1091.837370] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.837606] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.837773] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.838092] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.838327] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.838571] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-575c40a4-d799-474b-b70e-ef13d4457a89" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.198939] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.198939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.198939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.198939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.198939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.198939] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 is going to be updated. [ 1092.227485] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.243088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.243270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.243344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.243575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.243725] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.255176] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: IN_PROGRESS for 2s [ 1092.566027] env[69491]: INFO networking_nsxv3.common.synchronization [req-0fd87ad6-5323-41f4-bdc6-aceccf3576b4 req-6474354c-699c-4a64-b670-3fdaad4c71db service nova] Enqueued Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_rules [ 1092.566027] env[69491]: INFO networking_nsxv3.common.synchronization [req-0fd87ad6-5323-41f4-bdc6-aceccf3576b4 req-6474354c-699c-4a64-b670-3fdaad4c71db service nova] Enqueued Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_members [ 1092.566027] env[69491]: INFO networking_nsxv3.common.synchronization [req-0fd87ad6-5323-41f4-bdc6-aceccf3576b4 req-6474354c-699c-4a64-b670-3fdaad4c71db service nova] Enqueued Resource ID: 575c40a4-d799-474b-b70e-ef13d4457a89 with Priority: HIGHEST for action port [ 1092.566027] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_rules [ 1092.566027] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_members [ 1092.566027] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575c40a4-d799-474b-b70e-ef13d4457a89 with Priority: HIGHEST for action port [ 1092.566027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.566027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.566609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.569663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.569663] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.569663] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.569663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.569663] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-575c40a4-d799-474b-b70e-ef13d4457a89 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.569663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-575c40a4-d799-474b-b70e-ef13d4457a89" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.569663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-575c40a4-d799-474b-b70e-ef13d4457a89" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.569663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-575c40a4-d799-474b-b70e-ef13d4457a89" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.569663] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('575c40a4-d799-474b-b70e-ef13d4457a89',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.730180] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.070999] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.071378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.072452] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 575c40a4-d799-474b-b70e-ef13d4457a89 with status ACTIVE [ 1093.072635] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.072745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.072848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.073032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.073124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.073294] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.073390] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.073453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.073622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.073709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.073890] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.073983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.074055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.074200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.074273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.074356] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 575c40a4-d799-474b-b70e-ef13d4457a89 is going to be updated. [ 1093.094558] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.094736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.094736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.094940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.095101] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.095259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-575c40a4-d799-474b-b70e-ef13d4457a89" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.230123] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: SUCCESS [ 1093.230360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.232957] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.233109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.233197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.233447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.233540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.233640] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1093.282725] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.282878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.282945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.283185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.283332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.294022] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1093.386383] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: SUCCESS [ 1093.386669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.264559] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: SUCCESS [ 1094.264819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.265078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.265297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.265510] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.265657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.265744] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.265926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.266051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.266152] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.768511] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.271866] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.305524] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1095.305758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.775809] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.775809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.775809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.775809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.775809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.775809] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 is going to be updated. [ 1095.809268] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.810412] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.810593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.810798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.810955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.821204] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: IN_PROGRESS for 2s [ 1095.963305] env[69491]: INFO networking_nsxv3.common.synchronization [None req-7886eba5-97dd-459f-8e1b-93b852ad12a9 tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGHEST for action security_group_rules [ 1095.963305] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGHEST for action security_group_rules [ 1095.963305] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7c6f902-1ed1-48d9-b962-db2feb55482d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.963305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.963305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.963305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.963305] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7c6f902-1ed1-48d9-b962-db2feb55482d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.125152] env[69491]: INFO networking_nsxv3.common.synchronization [req-847f52ee-3b0d-40a3-8bee-43fa1f59d8c8 req-aa3bd5f7-87e9-47ae-a4a2-a6d3af603262 tempest-ServerRescueTestJSON-1463555039 tempest-ServerRescueTestJSON-1463555039-project-member] Enqueued Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_members [ 1096.125152] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGHEST for action security_group_members [ 1096.125152] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.125152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.125152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.126174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.126467] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.126919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.127094] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.127365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.127546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.127730] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.195083] env[69491]: INFO networking_nsxv3.common.synchronization [None req-ead40546-a8a9-48ea-9559-434271b86ee7 tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGHEST for action security_group_rules [ 1096.195899] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGHEST for action security_group_rules [ 1096.198477] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7c6f902-1ed1-48d9-b962-db2feb55482d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.198477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.484756] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.485056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.485056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.485221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.485307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.485406] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7c6f902-1ed1-48d9-b962-db2feb55482d already deleted. [ 1096.485501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.485660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.485816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.485900] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7c6f902-1ed1-48d9-b962-db2feb55482d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.630044] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.630322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.630322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.630588] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.655877] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.656398] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.656567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.656707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.657076] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.657243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.657628] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab is going to be updated. [ 1096.688476] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.688774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.688893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.689257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.689588] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.700488] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: IN_PROGRESS for 2s [ 1097.008369] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.008552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.008621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.008857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.008977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.009101] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7c6f902-1ed1-48d9-b962-db2feb55482d already deleted. [ 1097.009202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.434840] env[69491]: INFO networking_nsxv3.common.synchronization [req-60c2f0cc-22d1-497b-9f8a-70a02b653457 req-69b36102-7456-45c0-b076-8fe236bf100f tempest-ServersAdminTestJSON-362478418 tempest-ServersAdminTestJSON-362478418-project-member] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 1097.435490] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 1097.435800] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.435954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.438912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.438912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.438912] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.438912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.438912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.438912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.438912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.438912] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.832416] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: SUCCESS [ 1097.832816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.832891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.833182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.833397] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.833539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.833631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.833835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.833932] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.834069] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.834214] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.940100] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.336855] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.444068] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.710288] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab in Status: SUCCESS [ 1098.710528] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab deletion is rescheduled due to dependency. [ 1098.710681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.840826] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2718fb34-4e94-4380-bd09-5b025d3b2125: rpc.has_security_group_logging(os_id): False [ 1098.858834] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.859155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.859155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.859290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.879011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.879344] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.879498] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.879570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.879774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.879860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.879951] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 is going to be updated. [ 1098.938802] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.938802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.938802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.938802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.939091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.949503] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.949890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.949890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.949890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.949974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.950036] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 1098.954513] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: IN_PROGRESS for 2s [ 1098.999196] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.999196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.999196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.999196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.999196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.011060] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 1100.969141] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: SUCCESS [ 1100.969430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.021692] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 1101.021931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.099493] env[69491]: INFO networking_nsxv3.common.synchronization [req-6c183aba-a793-406d-92c8-67e751a73fcd req-0782a00b-e8a1-4f60-a911-2e36ba42b4f4 tempest-ServerDiskConfigTestJSON-964931906 tempest-ServerDiskConfigTestJSON-964931906-project-member] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 1101.100433] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 1101.100433] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.100433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.100433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.100682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.102026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.102026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.102026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.102026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.102026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.102026] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.600633] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-956 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.600633] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.600633] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.600633] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.600633] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.600633] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.602463] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.603538] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.603943] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.604736] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.604736] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.605057] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.607015] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.607015] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.607015] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.607015] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.608483] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.608784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.608990] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.609286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.609560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.610193] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.612141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.612141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.612141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.612141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.612141] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be deleted. [ 1101.638350] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.638350] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1101.638350] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.638350] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-956" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.638350] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-71b30ec1-2cb7-453f-aed6-c3eb0ca11173 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.638350] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-71b30ec1-2cb7-453f-aed6-c3eb0ca11173" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.639324] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-71b30ec1-2cb7-453f-aed6-c3eb0ca11173" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.640088] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-71b30ec1-2cb7-453f-aed6-c3eb0ca11173" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.640468] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71b30ec1-2cb7-453f-aed6-c3eb0ca11173',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.651777] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.651777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.651777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.652597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.653271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.653271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.143937] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.144404] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.144404] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.144699] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.145037] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.145108] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 71b30ec1-2cb7-453f-aed6-c3eb0ca11173 not found, creating... [ 1102.145377] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.146199] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.146199] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.146199] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.146199] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.146432] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.146615] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.146746] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.146977] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.147156] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.147327] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 71b30ec1-2cb7-453f-aed6-c3eb0ca11173 is going to be created. [ 1102.183131] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.184870] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.184870] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.184870] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.184870] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.184870] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-71b30ec1-2cb7-453f-aed6-c3eb0ca11173" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.042020] env[69491]: INFO networking_nsxv3.common.synchronization [req-6c183aba-a793-406d-92c8-67e751a73fcd req-2505cf9c-abc2-426e-aca5-1329e5e32d5a service nova] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_rules [ 1103.042020] env[69491]: INFO networking_nsxv3.common.synchronization [req-6c183aba-a793-406d-92c8-67e751a73fcd req-2505cf9c-abc2-426e-aca5-1329e5e32d5a service nova] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 1103.042020] env[69491]: INFO networking_nsxv3.common.synchronization [req-6c183aba-a793-406d-92c8-67e751a73fcd req-2505cf9c-abc2-426e-aca5-1329e5e32d5a service nova] Enqueued Resource ID: 71b30ec1-2cb7-453f-aed6-c3eb0ca11173 with Priority: HIGHEST for action port [ 1103.042020] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_rules [ 1103.042020] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 1103.042020] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b30ec1-2cb7-453f-aed6-c3eb0ca11173 with Priority: HIGHEST for action port [ 1103.043484] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.043794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.043942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.044236] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.044413] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.045441] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.045642] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.045780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.047017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.047017] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.047017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.047017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.047017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.047017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.047017] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.047692] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-71b30ec1-2cb7-453f-aed6-c3eb0ca11173 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.047919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71b30ec1-2cb7-453f-aed6-c3eb0ca11173" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.048072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71b30ec1-2cb7-453f-aed6-c3eb0ca11173" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.048296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71b30ec1-2cb7-453f-aed6-c3eb0ca11173" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.048467] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71b30ec1-2cb7-453f-aed6-c3eb0ca11173',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.260844] env[69491]: INFO networking_nsxv3.common.synchronization [None req-4dedcb5f-efd5-4572-927e-683044f25c86 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 1103.262122] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 1103.262122] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.262122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.262122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.262122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.262122] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.262837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.263400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.264344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.264344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.264344] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.552857] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.553018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.553231] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.554152] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71b30ec1-2cb7-453f-aed6-c3eb0ca11173 with status ACTIVE [ 1103.554338] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.554526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.554802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.554876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.554926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.555189] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.555337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.555411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.555582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.555662] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.556070] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.556920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.557319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.557987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.558153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.558296] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71b30ec1-2cb7-453f-aed6-c3eb0ca11173 is going to be updated. [ 1103.584971] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.585139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.585207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.585935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.585935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.585935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71b30ec1-2cb7-453f-aed6-c3eb0ca11173" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.748940] env[69491]: INFO networking_nsxv3.common.synchronization [None req-25411295-8dad-4070-ab9d-2c08687c0c47 None None] Enqueued Resource ID: 3aa661d5-08ef-46a0-abd0-6c0acabd49c9 with Priority: HIGHEST for action port [ 1103.749758] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aa661d5-08ef-46a0-abd0-6c0acabd49c9 with Priority: HIGHEST for action port [ 1103.750219] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-3aa661d5-08ef-46a0-abd0-6c0acabd49c9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.750353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3aa661d5-08ef-46a0-abd0-6c0acabd49c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.750465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3aa661d5-08ef-46a0-abd0-6c0acabd49c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.750912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3aa661d5-08ef-46a0-abd0-6c0acabd49c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.750912] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3aa661d5-08ef-46a0-abd0-6c0acabd49c9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.769429] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.769701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.769821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.770941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.770941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.770941] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.770941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.770941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.770941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.770941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.771288] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be deleted. [ 1103.814217] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.814374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.814449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.814754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.814877] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.814990] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.060858] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.253957] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3aa661d5-08ef-46a0-abd0-6c0acabd49c9 [ 1104.254227] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.254366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.254455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.254682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.254791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.254888] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3aa661d5-08ef-46a0-abd0-6c0acabd49c9 already deleted. [ 1104.254978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3aa661d5-08ef-46a0-abd0-6c0acabd49c9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.564733] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.565033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.565033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.565176] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.565228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.565344] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be created. [ 1104.595427] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.595427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.595596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.595682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.595849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.607064] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: UNINITIALIZED for 2s [ 1105.130703] env[69491]: INFO networking_nsxv3.common.synchronization [req-340f555a-0b4b-41a6-9365-b67b6185b8ab req-fb9b9570-2dd0-496b-a311-65ccc65cdd09 tempest-ServerRescueNegativeTestJSON-1517573171 tempest-ServerRescueNegativeTestJSON-1517573171-project-member] Enqueued Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_members [ 1105.131143] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGHEST for action security_group_members [ 1105.131608] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.131793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.131901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.133031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.133031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.133031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.133031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.133485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.133485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.133485] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.636132] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.636439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.636439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.636672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.668027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.668027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.668027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.668027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.668027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.668027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.668027] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88118802-dd47-4c99-a6fd-7180a306f792 is going to be updated. [ 1105.709750] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.709750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.709750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.709750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.709750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.719550] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: IN_PROGRESS for 2s [ 1105.838487] env[69491]: INFO networking_nsxv3.common.synchronization [None req-1043aa8b-19a6-4a2f-be0c-1eb5576d1a5c None None] Enqueued Resource ID: 84198cc6-c71f-4ab3-af6d-0e47736b70e1 with Priority: HIGHEST for action port [ 1105.838655] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84198cc6-c71f-4ab3-af6d-0e47736b70e1 with Priority: HIGHEST for action port [ 1105.839270] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-84198cc6-c71f-4ab3-af6d-0e47736b70e1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.839429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84198cc6-c71f-4ab3-af6d-0e47736b70e1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.839585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84198cc6-c71f-4ab3-af6d-0e47736b70e1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.839726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84198cc6-c71f-4ab3-af6d-0e47736b70e1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.839860] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84198cc6-c71f-4ab3-af6d-0e47736b70e1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.346551] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84198cc6-c71f-4ab3-af6d-0e47736b70e1 [ 1106.346666] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.346789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.347575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.347575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.347575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.347575] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84198cc6-c71f-4ab3-af6d-0e47736b70e1 already deleted. [ 1106.347834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84198cc6-c71f-4ab3-af6d-0e47736b70e1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.617865] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 1106.618071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.618252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.618485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.618698] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.618820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.618887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.619056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.619667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.619667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.619667] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.122970] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.122970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.122970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.122970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.122970] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.122970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.122970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.123552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.123552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.123552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.123552] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.123552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.123768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.123768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.124250] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.124347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.125754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.125754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.125754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.125754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.125754] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.628020] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab7773f0-7815-4a45-bf15-8a8079aa86ff: rpc.has_security_group_logging(os_id): False [ 1107.647601] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.647786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.647918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.648172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.648363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.648625] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.648724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.648773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.648946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.649037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.649280] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.649417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.649517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.649678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.649755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.650017] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.650137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.650229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.650385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.650460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.650548] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be created. [ 1107.715578] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.715911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.715911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.716073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.716272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.729058] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88118802-dd47-4c99-a6fd-7180a306f792 in Status: SUCCESS [ 1107.729304] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88118802-dd47-4c99-a6fd-7180a306f792 deletion is rescheduled due to dependency. [ 1107.729389] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.730731] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 1109.387205] env[69491]: INFO networking_nsxv3.common.synchronization [req-27aedf32-205d-45e2-ab6f-22508a16a371 req-fe1230ff-9a12-42bc-ac19-61be2551cf92 tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGHEST for action security_group_members [ 1109.387585] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGHEST for action security_group_members [ 1109.387965] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c6f902-1ed1-48d9-b962-db2feb55482d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.388209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.388209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.388529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.388915] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.388915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.388915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.389111] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.389285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.389371] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7c6f902-1ed1-48d9-b962-db2feb55482d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.747422] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 1109.747560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.788159] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-348 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.788159] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.788159] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.788159] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.788986] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.789843] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.790729] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.790729] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.791016] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.791413] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.791705] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.791967] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.792248] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.792517] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.792768] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.793057] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.813677] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.814112] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1109.814415] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.814758] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.815306] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-89541482-e37d-4ef8-a055-4510b27f8b00 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.815661] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-89541482-e37d-4ef8-a055-4510b27f8b00" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.815930] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-89541482-e37d-4ef8-a055-4510b27f8b00" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.816466] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-89541482-e37d-4ef8-a055-4510b27f8b00" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.816758] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89541482-e37d-4ef8-a055-4510b27f8b00',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.894540] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.894788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.894788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.895037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.895131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.895371] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.895479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.895543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.895710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.895812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.895901] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7c6f902-1ed1-48d9-b962-db2feb55482d already deleted. [ 1109.895985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.319587] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.319942] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.320194] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.320620] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.320879] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.321157] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 89541482-e37d-4ef8-a055-4510b27f8b00 not found, creating... [ 1110.321611] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.321883] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.322125] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.322566] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.322755] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.323236] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.323513] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.323723] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.324075] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.324309] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.324561] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 89541482-e37d-4ef8-a055-4510b27f8b00 is going to be created. [ 1110.374610] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.375019] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.375235] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.375604] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.375984] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.376382] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-89541482-e37d-4ef8-a055-4510b27f8b00" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.170813] env[69491]: INFO networking_nsxv3.common.synchronization [req-27aedf32-205d-45e2-ab6f-22508a16a371 req-df95f42d-c5bb-49af-810e-6129fc5fdfb6 service nova] Enqueued Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGHEST for action security_group_rules [ 1111.170813] env[69491]: INFO networking_nsxv3.common.synchronization [req-27aedf32-205d-45e2-ab6f-22508a16a371 req-df95f42d-c5bb-49af-810e-6129fc5fdfb6 service nova] Enqueued Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGHEST for action security_group_members [ 1111.170813] env[69491]: INFO networking_nsxv3.common.synchronization [req-27aedf32-205d-45e2-ab6f-22508a16a371 req-df95f42d-c5bb-49af-810e-6129fc5fdfb6 service nova] Enqueued Resource ID: 89541482-e37d-4ef8-a055-4510b27f8b00 with Priority: HIGHEST for action port [ 1111.171279] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGHEST for action security_group_rules [ 1111.171429] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGHEST for action security_group_members [ 1111.171522] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89541482-e37d-4ef8-a055-4510b27f8b00 with Priority: HIGHEST for action port [ 1111.171799] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7c6f902-1ed1-48d9-b962-db2feb55482d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.171917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.171981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.173392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.173392] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7c6f902-1ed1-48d9-b962-db2feb55482d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.173577] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c6f902-1ed1-48d9-b962-db2feb55482d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.173713] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.173794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.173982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.174370] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.174681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.178031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.178031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.178031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.178031] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7c6f902-1ed1-48d9-b962-db2feb55482d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.178031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-89541482-e37d-4ef8-a055-4510b27f8b00 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.178031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89541482-e37d-4ef8-a055-4510b27f8b00" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.178031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89541482-e37d-4ef8-a055-4510b27f8b00" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.178031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89541482-e37d-4ef8-a055-4510b27f8b00" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.178031] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89541482-e37d-4ef8-a055-4510b27f8b00',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.217537] env[69491]: INFO networking_nsxv3.common.synchronization [req-66b79462-6091-43da-9588-adf1f6c94780 req-67ff191e-cb6d-408a-b505-6c04b6cfd61f tempest-ServerActionsTestOtherB-761111206 tempest-ServerActionsTestOtherB-761111206-project-member] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 1111.218377] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 1111.218531] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.218697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.218775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.218953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.219075] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.219209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.219276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.219438] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.219608] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.219608] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.683143] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7c6f902-1ed1-48d9-b962-db2feb55482d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.683143] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c6f902-1ed1-48d9-b962-db2feb55482d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.683143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.683143] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89541482-e37d-4ef8-a055-4510b27f8b00 with status ACTIVE [ 1111.683143] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.683143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.683143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.683143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.683143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.683143] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.683143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.683143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.683143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.683143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.684899] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.689221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.689221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.689221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.689221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.689221] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89541482-e37d-4ef8-a055-4510b27f8b00 is going to be updated. [ 1111.719415] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.719831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.719831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.719831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.720136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.720191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89541482-e37d-4ef8-a055-4510b27f8b00" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.721831] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.722154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.722154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.722358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.722358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.722564] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.722662] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.722783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.722971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.723064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.723165] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 1111.792439] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.792688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.792769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.793103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.793348] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.805269] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 1112.189659] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7c6f902-1ed1-48d9-b962-db2feb55482d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.484408] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.484611] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.484740] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.485045] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.485359] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.485543] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.485667] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.485910] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.486094] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.486335] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1112.486465] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.486594] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.486721] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.486844] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1112.486969] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.487691] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.508013] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.508273] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1112.508489] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.508696] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.509038] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-4948be80-80c3-4942-b696-456830a71ee7 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.509297] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.509429] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.509773] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.509921] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4948be80-80c3-4942-b696-456830a71ee7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.692996] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.693267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.693505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.693838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.694060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.694247] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7c6f902-1ed1-48d9-b962-db2feb55482d is going to be created. [ 1112.719142] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.719366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.719422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.719653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.719862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.734666] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7c6f902-1ed1-48d9-b962-db2feb55482d in Status: UNINITIALIZED for 2s [ 1113.012982] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.013418] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.013418] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.013680] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.013877] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.013996] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 4948be80-80c3-4942-b696-456830a71ee7 not found, creating... [ 1113.014340] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.014516] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.014639] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.014881] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.015110] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.015588] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.015735] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.015847] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.016136] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.016348] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.016523] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 4948be80-80c3-4942-b696-456830a71ee7 is going to be created. [ 1113.037994] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.038317] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.038489] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.038833] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.039200] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.039494] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.815837] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 1113.816191] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 deletion is rescheduled due to dependency. [ 1113.816191] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.831728] env[69491]: INFO networking_nsxv3.common.synchronization [req-1baffda8-bb05-431c-8e98-537040f3c9c9 req-49a79f3a-0bee-4115-bb3a-47baa0e90867 service nova] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_rules [ 1113.831943] env[69491]: INFO networking_nsxv3.common.synchronization [req-1baffda8-bb05-431c-8e98-537040f3c9c9 req-49a79f3a-0bee-4115-bb3a-47baa0e90867 service nova] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 1113.832162] env[69491]: INFO networking_nsxv3.common.synchronization [req-1baffda8-bb05-431c-8e98-537040f3c9c9 req-49a79f3a-0bee-4115-bb3a-47baa0e90867 service nova] Enqueued Resource ID: 4948be80-80c3-4942-b696-456830a71ee7 with Priority: HIGHEST for action port [ 1113.832779] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_rules [ 1113.832921] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 1113.833523] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4948be80-80c3-4942-b696-456830a71ee7 with Priority: HIGHEST for action port [ 1113.833886] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.834032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.834104] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.834325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.834410] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.835565] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.835835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.835835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.835955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.836134] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.836269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.836396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.836571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.836663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.836759] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.838680] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-4948be80-80c3-4942-b696-456830a71ee7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.838996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.838996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.839276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.839377] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4948be80-80c3-4942-b696-456830a71ee7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.211487] env[69491]: INFO networking_nsxv3.common.synchronization [req-1f8661a4-65cd-4f84-84ee-4783676d8d7b req-8fe4f11c-5b8a-4310-8cc9-254a2148ac70 tempest-MultipleCreateTestJSON-326272290 tempest-MultipleCreateTestJSON-326272290-project-member] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1114.212112] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1114.212383] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.212527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.212590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.212805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.212956] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.213057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.213123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.213265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.213350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.213440] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.320880] env[69491]: INFO networking_nsxv3.common.synchronization [req-e60f8178-31d8-4bbf-bea0-7a6a57edb453 req-00b36869-6e4d-4ea1-9224-ce677ae74668 tempest-ServersAdminTestJSON-362478418 tempest-ServersAdminTestJSON-362478418-project-member] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 1114.321451] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGHEST for action security_group_members [ 1114.321763] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.321887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.321952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.322615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.322786] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.322895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.322975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.323131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.323222] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.323315] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.340954] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.341128] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.341288] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.342191] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4948be80-80c3-4942-b696-456830a71ee7 with status ACTIVE [ 1114.342333] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.342448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.342514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.342718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.342808] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.342978] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.343096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.343157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.343364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.347261] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.347471] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.347576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.347749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.347967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.347967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.347967] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4948be80-80c3-4942-b696-456830a71ee7 is going to be updated. [ 1114.371388] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.371388] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.371388] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.371388] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.371633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.371678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.720061] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.720061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.720061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.720061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.720061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.720061] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.720061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.720061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.720061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.720061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.720061] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 already deleted. [ 1114.720061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.746154] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7c6f902-1ed1-48d9-b962-db2feb55482d in Status: SUCCESS [ 1114.746778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.746984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.747255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.747455] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.747577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.747643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.747795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.747876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.747960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.748062] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7c6f902-1ed1-48d9-b962-db2feb55482d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.807429] env[69491]: INFO networking_nsxv3.common.synchronization [req-f9c1215b-7bb0-4068-9cf8-c0fcaa2c7023 req-22448625-f95c-40e6-b656-44ffacd0b35f tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_members [ 1114.807963] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_members [ 1114.808916] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.808916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.808916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.808916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.808916] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.808916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.809281] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.809391] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.809519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.809667] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.827954] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.828297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.828297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.828634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.832019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.832019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.832019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.832019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.832019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.832019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.832019] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be updated. [ 1114.834930] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.835162] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.835335] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.835583] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.835834] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.835987] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.836143] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.836408] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.836559] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.839658] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.839788] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.839908] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.840053] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.840241] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.840406] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.840596] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.850273] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.864340] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.864713] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1114.864976] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.865313] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.865841] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-3b50b8ed-6d41-4789-bc30-e8492fc62701 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.866178] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-3b50b8ed-6d41-4789-bc30-e8492fc62701" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.866417] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-3b50b8ed-6d41-4789-bc30-e8492fc62701" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.866947] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-3b50b8ed-6d41-4789-bc30-e8492fc62701" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.871018] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b50b8ed-6d41-4789-bc30-e8492fc62701',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.871018] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.871018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.871717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.871717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.871717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.880880] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: IN_PROGRESS for 2s [ 1115.252048] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7c6f902-1ed1-48d9-b962-db2feb55482d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.312554] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.312739] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.312796] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.313059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.313156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.313703] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.313703] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.313703] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.313703] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.313926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.313926] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 is going to be updated. [ 1115.353127] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.353336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.353336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.353496] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.353566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.353686] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be created. [ 1115.370904] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.371184] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.371365] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.371866] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.371866] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.372059] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 3b50b8ed-6d41-4789-bc30-e8492fc62701 not found, creating... [ 1115.372299] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.372496] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.372659] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.372923] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.373088] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.373412] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.373577] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.373741] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.373938] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.374083] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.374241] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 3b50b8ed-6d41-4789-bc30-e8492fc62701 is going to be created. [ 1115.382031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.382213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.382312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.382546] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.382770] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.397849] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.398112] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.398164] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.398406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.398612] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.401582] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: IN_PROGRESS for 2s [ 1115.412727] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: UNINITIALIZED for 2s [ 1115.420251] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.421456] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.421595] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.421857] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.422135] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.422404] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-3b50b8ed-6d41-4789-bc30-e8492fc62701" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.754436] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7c6f902-1ed1-48d9-b962-db2feb55482d: rpc.has_security_group_logging(os_id): False [ 1115.776252] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.776405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.776480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.776761] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.776920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.777273] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.777379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.777448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.777620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.777700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.777788] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7c6f902-1ed1-48d9-b962-db2feb55482d is going to be created. [ 1115.841146] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.841681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.841681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.841681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.841849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.854830] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7c6f902-1ed1-48d9-b962-db2feb55482d in Status: IN_PROGRESS for 2s [ 1116.404225] env[69491]: INFO networking_nsxv3.common.synchronization [req-1f8661a4-65cd-4f84-84ee-4783676d8d7b req-7cd0e023-b04d-41fd-827a-e22750f720b1 service nova] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_rules [ 1116.404406] env[69491]: INFO networking_nsxv3.common.synchronization [req-1f8661a4-65cd-4f84-84ee-4783676d8d7b req-7cd0e023-b04d-41fd-827a-e22750f720b1 service nova] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1116.404551] env[69491]: INFO networking_nsxv3.common.synchronization [req-1f8661a4-65cd-4f84-84ee-4783676d8d7b req-7cd0e023-b04d-41fd-827a-e22750f720b1 service nova] Enqueued Resource ID: 3b50b8ed-6d41-4789-bc30-e8492fc62701 with Priority: HIGHEST for action port [ 1116.404779] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_rules [ 1116.404908] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1116.405021] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b50b8ed-6d41-4789-bc30-e8492fc62701 with Priority: HIGHEST for action port [ 1116.405826] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.405971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.406054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.406270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.406367] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.407865] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.408010] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.408090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.408331] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.408436] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.408535] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.408598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.408743] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.408830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.408917] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.410304] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b50b8ed-6d41-4789-bc30-e8492fc62701 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.410419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b50b8ed-6d41-4789-bc30-e8492fc62701" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.410502] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b50b8ed-6d41-4789-bc30-e8492fc62701" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.410666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b50b8ed-6d41-4789-bc30-e8492fc62701" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.410746] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b50b8ed-6d41-4789-bc30-e8492fc62701',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.547730] env[69491]: INFO networking_nsxv3.common.synchronization [req-1f8661a4-65cd-4f84-84ee-4783676d8d7b req-f9fa11d1-ae7b-4e3d-be5f-24d44bb44cd9 tempest-MultipleCreateTestJSON-326272290 tempest-MultipleCreateTestJSON-326272290-project-member] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1116.548312] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1116.548633] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.548731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.893091] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfca2b7-f089-437e-979a-24f210590561 in Status: SUCCESS [ 1116.893546] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfca2b7-f089-437e-979a-24f210590561 deletion is rescheduled due to dependency. [ 1116.893674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.909048] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.909226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.910569] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.912086] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b50b8ed-6d41-4789-bc30-e8492fc62701 with status ACTIVE [ 1116.912326] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.912470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.912543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.912779] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.912878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.913574] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.913574] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.913574] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.913574] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.913574] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.913793] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.913885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.914072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.914145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.914204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.914295] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b50b8ed-6d41-4789-bc30-e8492fc62701 is going to be updated. [ 1116.925178] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.925436] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.925544] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.925815] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.926089] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.926259] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.926570] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.926725] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.926873] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.927210] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.927278] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.927383] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.927505] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.927634] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.927744] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.927890] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.941524] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.941718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.941825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.942052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.942215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.942396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b50b8ed-6d41-4789-bc30-e8492fc62701" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.948180] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.948404] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1116.948608] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.948832] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-81" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.949310] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-8a24c0b6-2c21-49c8-9620-5888bd67c7b8 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.949527] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-8a24c0b6-2c21-49c8-9620-5888bd67c7b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.949711] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-8a24c0b6-2c21-49c8-9620-5888bd67c7b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.950139] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-8a24c0b6-2c21-49c8-9620-5888bd67c7b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.950273] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a24c0b6-2c21-49c8-9620-5888bd67c7b8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.404780] env[69491]: INFO networking_nsxv3.common.synchronization [req-51911131-0e33-469e-8f06-84217cc06c6c req-108c7eff-449c-4a58-b48c-af80fc8be8c4 tempest-ServerDiskConfigTestJSON-964931906 tempest-ServerDiskConfigTestJSON-964931906-project-member] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 1117.405347] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGHEST for action security_group_members [ 1117.406105] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.406240] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.406310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.406512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.406671] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.406798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.406840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.406970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.407068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.407159] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.413322] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: SUCCESS [ 1117.413483] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 deletion is rescheduled due to dependency. [ 1117.413591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.413799] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.421905] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 1117.422140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.422695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.422900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.423097] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.423214] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.423280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.423432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.423511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.423600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.423678] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.453032] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.453231] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.453445] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.453655] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.453811] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.453994] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 8a24c0b6-2c21-49c8-9620-5888bd67c7b8 not found, creating... [ 1117.454239] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.454408] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.454532] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.454792] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.454936] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.455242] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.455416] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.455533] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.455747] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.455888] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.456050] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 8a24c0b6-2c21-49c8-9620-5888bd67c7b8 is going to be created. [ 1117.476565] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.476743] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.476883] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.477200] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.477444] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.477672] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-8a24c0b6-2c21-49c8-9620-5888bd67c7b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.865894] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7c6f902-1ed1-48d9-b962-db2feb55482d in Status: SUCCESS [ 1117.866182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.911551] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.911551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.911551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.911551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.911551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.911551] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.911551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.911551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.911551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.911551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.911551] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be updated. [ 1117.916992] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.917147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.917147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.918031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.918031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.918031] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be created. [ 1117.925869] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.926025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.926088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.926352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.926524] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.926629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.926692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.927410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.927410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.927410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.927410] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.927410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.927410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.927410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.927684] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.927684] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.927684] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.927812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.927882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.927964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.928062] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.944117] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.944324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.944366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.944557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.944716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.947333] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.947525] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.947525] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.947690] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.947811] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.958665] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: IN_PROGRESS for 2s [ 1117.959350] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: UNINITIALIZED for 2s [ 1118.156446] env[69491]: INFO networking_nsxv3.common.synchronization [req-1f8661a4-65cd-4f84-84ee-4783676d8d7b req-0824dc79-24fc-4728-abc6-33625ad64a42 service nova] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_rules [ 1118.156632] env[69491]: INFO networking_nsxv3.common.synchronization [req-1f8661a4-65cd-4f84-84ee-4783676d8d7b req-0824dc79-24fc-4728-abc6-33625ad64a42 service nova] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1118.156778] env[69491]: INFO networking_nsxv3.common.synchronization [req-1f8661a4-65cd-4f84-84ee-4783676d8d7b req-0824dc79-24fc-4728-abc6-33625ad64a42 service nova] Enqueued Resource ID: 8a24c0b6-2c21-49c8-9620-5888bd67c7b8 with Priority: HIGHEST for action port [ 1118.157045] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_rules [ 1118.157179] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1118.157276] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a24c0b6-2c21-49c8-9620-5888bd67c7b8 with Priority: HIGHEST for action port [ 1118.157820] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.157948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.158217] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.158316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.158487] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a24c0b6-2c21-49c8-9620-5888bd67c7b8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.158595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a24c0b6-2c21-49c8-9620-5888bd67c7b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.158650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a24c0b6-2c21-49c8-9620-5888bd67c7b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.158848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a24c0b6-2c21-49c8-9620-5888bd67c7b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.158928] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a24c0b6-2c21-49c8-9620-5888bd67c7b8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.430020] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9632268c-db1a-4548-9652-b638bc84b886: rpc.has_security_group_logging(os_id): False [ 1118.448288] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.448434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.448504] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.448713] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.448834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.449071] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.449175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.449238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.449400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.449677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.449677] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.449752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.449796] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.449943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.450060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.450259] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.450360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.450422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.450566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.450640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.450726] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be created. [ 1118.510374] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.510547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.510623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.510841] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.511036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.522568] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: IN_PROGRESS for 2s [ 1118.663438] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a24c0b6-2c21-49c8-9620-5888bd67c7b8 with status ACTIVE [ 1118.663771] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.663917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.663998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.664242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.664338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.664505] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.664601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.664665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.664818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.665040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.665105] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.665376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.665376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.665376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.665513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.665513] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a24c0b6-2c21-49c8-9620-5888bd67c7b8 is going to be updated. [ 1118.699117] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.699282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.699346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.699566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.699693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.699916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a24c0b6-2c21-49c8-9620-5888bd67c7b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.753104] env[69491]: INFO networking_nsxv3.common.synchronization [req-41bf287d-1409-4967-9e27-ebb1601bb460 req-2258e843-b53b-45f5-84a4-cfe5181f69f2 tempest-DeleteServersTestJSON-1018355336 tempest-DeleteServersTestJSON-1018355336-project-member] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1118.753745] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1118.754115] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.754252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.754983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.754983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.754983] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.754983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.754983] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.755225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.755225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.755952] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.037935] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.038237] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.038295] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.038573] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.038834] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.039076] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.039287] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.039593] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.039766] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.040018] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1119.040152] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.040271] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.040387] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.040506] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1119.040619] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.040758] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.063377] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.063558] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1119.063736] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.064016] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.064379] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-b8761dc4-3196-47d5-9d88-440719be9d31 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.064566] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-b8761dc4-3196-47d5-9d88-440719be9d31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.064696] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-b8761dc4-3196-47d5-9d88-440719be9d31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.065042] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-b8761dc4-3196-47d5-9d88-440719be9d31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.065195] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8761dc4-3196-47d5-9d88-440719be9d31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.257628] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.261207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.261364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.261653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.261750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.261991] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.262128] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.262198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.262350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.262428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.262727] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1119.297506] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.297677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.297737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.297929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.298121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.310665] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1119.571023] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.571023] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.571023] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.571023] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.571023] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.571023] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port b8761dc4-3196-47d5-9d88-440719be9d31 not found, creating... [ 1119.571023] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.571023] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.571023] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.571023] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.571023] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.571489] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.571489] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.571489] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.571489] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.571489] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.571489] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: b8761dc4-3196-47d5-9d88-440719be9d31 is going to be created. [ 1119.591381] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.591626] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.591762] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.592074] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.592403] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.592692] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-b8761dc4-3196-47d5-9d88-440719be9d31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.979675] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: SUCCESS [ 1119.979939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.980149] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.980385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.980576] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.980697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.980762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.980916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.980999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.981110] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.986082] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff in Status: SUCCESS [ 1119.986082] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff deletion is rescheduled due to dependency. [ 1119.986082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.347676] env[69491]: INFO networking_nsxv3.common.synchronization [req-41bf287d-1409-4967-9e27-ebb1601bb460 req-77e37848-a733-4b04-ba9b-84e0c8b8f2e0 service nova] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_rules [ 1120.347960] env[69491]: INFO networking_nsxv3.common.synchronization [req-41bf287d-1409-4967-9e27-ebb1601bb460 req-77e37848-a733-4b04-ba9b-84e0c8b8f2e0 service nova] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1120.348037] env[69491]: INFO networking_nsxv3.common.synchronization [req-41bf287d-1409-4967-9e27-ebb1601bb460 req-77e37848-a733-4b04-ba9b-84e0c8b8f2e0 service nova] Enqueued Resource ID: b8761dc4-3196-47d5-9d88-440719be9d31 with Priority: HIGHEST for action port [ 1120.348234] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_rules [ 1120.348368] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1120.348466] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8761dc4-3196-47d5-9d88-440719be9d31 with Priority: HIGHEST for action port [ 1120.349285] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.349902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.349902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.349902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.349902] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.351117] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.351220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.351561] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8761dc4-3196-47d5-9d88-440719be9d31 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.351653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8761dc4-3196-47d5-9d88-440719be9d31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.351653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8761dc4-3196-47d5-9d88-440719be9d31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.351823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8761dc4-3196-47d5-9d88-440719be9d31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.351890] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8761dc4-3196-47d5-9d88-440719be9d31',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.484863] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.537774] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 1120.538167] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.852419] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.852705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.855199] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8761dc4-3196-47d5-9d88-440719be9d31 with status ACTIVE [ 1120.855506] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.855647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.855747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.855942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.856044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.856224] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.856324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.856389] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.856544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.856622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.856799] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.856920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.856978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.857113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.857189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.857275] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8761dc4-3196-47d5-9d88-440719be9d31 is going to be updated. [ 1120.880898] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.881115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.881186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.881428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.881650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.881744] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8761dc4-3196-47d5-9d88-440719be9d31" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.988615] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.323039] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1121.323256] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d deletion is rescheduled due to dependency. [ 1121.323397] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.323601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.323862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.324089] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.324265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.324344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.324516] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.324601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.324698] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.492803] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.492803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.492803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.492803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.493287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.493287] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be updated. [ 1121.543141] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.543374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.543486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.543716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.543917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.560297] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: IN_PROGRESS for 2s [ 1121.827676] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.865255] env[69491]: INFO networking_nsxv3.common.synchronization [req-244ccdee-b99a-40cd-8e4f-672454e58285 req-4c95da3d-78c6-46ad-b1d0-c7fa26bf8d38 tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1121.866145] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1121.867392] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.868587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.868587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.868587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.868587] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.868587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.868587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.868870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.869023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.869161] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.185153] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.185363] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.185496] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.185806] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.186191] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.186325] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.186460] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.186705] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.186861] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.187094] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.187222] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.187338] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.187455] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.187573] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.187686] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.187825] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.219290] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.219484] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1122.219632] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.219817] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.220250] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.220442] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.220571] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.220919] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.221414] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.330812] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.371769] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.723710] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.724019] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.724225] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.724555] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.724715] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.724886] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb not found, creating... [ 1122.725181] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.725401] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.725490] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.725731] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.725922] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.726254] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.726451] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.726661] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.727012] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.727187] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.727375] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb is going to be created. [ 1122.748872] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.748872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.748872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.748872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.748872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.748872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.832593] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.833557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.833557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.833557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.833557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.833557] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1122.874082] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.882832] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.883067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.883067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.883240] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.883394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.894741] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1123.376942] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.377091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.377131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.377349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.379307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.379307] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1123.424856] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.425091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.425091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.425299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.425456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.435806] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1123.441010] env[69491]: INFO networking_nsxv3.common.synchronization [req-244ccdee-b99a-40cd-8e4f-672454e58285 req-fb3cadb2-ccfd-4ab2-840c-f80eff59b869 service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 1123.441199] env[69491]: INFO networking_nsxv3.common.synchronization [req-244ccdee-b99a-40cd-8e4f-672454e58285 req-fb3cadb2-ccfd-4ab2-840c-f80eff59b869 service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1123.441384] env[69491]: INFO networking_nsxv3.common.synchronization [req-244ccdee-b99a-40cd-8e4f-672454e58285 req-fb3cadb2-ccfd-4ab2-840c-f80eff59b869 service nova] Enqueued Resource ID: 5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb with Priority: HIGHEST for action port [ 1123.441625] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 1123.441756] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1123.441856] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb with Priority: HIGHEST for action port [ 1123.442516] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.442647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.442716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.442966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.443015] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.443871] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.443969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.444226] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.444292] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.444340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.444518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.444616] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.574033] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: SUCCESS [ 1123.574033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.574033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.574033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.574033] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.574033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.574033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.574033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.574033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.574033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.574033] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.575221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.575510] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.575782] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.575961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.576089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.576324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.576455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.576617] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.949019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.949019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.949019] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb with status ACTIVE [ 1123.949019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.949019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.949019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.949019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.949019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.949019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.949019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.949019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.949019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.949019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.949019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.950847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.950847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.950847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.950847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.950847] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb is going to be updated. [ 1123.975979] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.976158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.976230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.976445] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.976586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.976749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fa43c9e-04e5-4ce4-a5b8-347d90ab0ebb" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.083411] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.084782] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.084901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.586871] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.904109] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1124.904293] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.904466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.904691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.904884] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.905017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.905078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.905243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.905319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.905404] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.905496] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.095029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.095367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.095367] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.095957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.095957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.095957] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be updated. [ 1125.136247] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.136247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.136247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.136247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.136247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.147946] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: IN_PROGRESS for 2s [ 1125.407919] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.408146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.408278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.408565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.408846] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.409049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.409119] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.409301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.409404] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.409501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.409666] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.409781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.409852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.410493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.410493] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.410493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.410493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.410493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.410754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.410754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.410754] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.446397] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1125.446633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.446833] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.447128] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.447324] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.447455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.447734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.447734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.447734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.447851] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.913581] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d: rpc.has_security_group_logging(os_id): False [ 1125.933767] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.933952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.933952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.934219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.934316] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.934542] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.934665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.934719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.934930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.935030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.935207] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.935297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.935359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.935503] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.935579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.935757] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.935865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.935920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.936089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.936161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.936200] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1125.950384] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.997973] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.998156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.998227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.998428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.998572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.011788] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1126.333010] env[69491]: INFO networking_nsxv3.common.synchronization [req-8f1c070b-ea32-461b-8f65-e7f0676ed113 req-9f57f518-95ad-4955-b72c-74833543c47b tempest-ImagesOneServerNegativeTestJSON-656208746 tempest-ImagesOneServerNegativeTestJSON-656208746-project-member] Enqueued Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1126.333580] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1126.334604] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.334920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.335051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.335393] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.335828] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.335955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.335955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.336077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.336158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.336463] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.453664] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.794021] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.794021] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.794357] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.794394] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.794956] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.794956] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.795354] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.795451] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.795577] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.795813] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1126.795965] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.796102] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.796221] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.796344] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1126.796459] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.796597] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.816055] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.816263] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1126.816425] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.816614] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.816946] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-62235fd1-1cde-49a4-bd25-309752caaf29 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.817150] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-62235fd1-1cde-49a4-bd25-309752caaf29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.817283] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-62235fd1-1cde-49a4-bd25-309752caaf29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.817626] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-62235fd1-1cde-49a4-bd25-309752caaf29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.817806] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62235fd1-1cde-49a4-bd25-309752caaf29',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.839081] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.839273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.839337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.839560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.839647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.839913] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.840037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.840094] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.840243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.840319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.840567] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e already deleted. [ 1126.840567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.956612] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.956612] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.956973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.956973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.957107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.957141] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1126.985965] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.986159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.986233] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.986451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.986597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.996961] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1127.164732] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: SUCCESS [ 1127.164964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.165175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.165488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.165693] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.165930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.166017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.166217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.166305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.166465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.166617] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.166775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.166867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.171104] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.171343] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.171447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.171516] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.171682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.171768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.171859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.171954] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.320185] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.320481] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.320652] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.321022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.321232] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.321436] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 62235fd1-1cde-49a4-bd25-309752caaf29 not found, creating... [ 1127.321778] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.322044] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.322207] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.322527] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.322722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.323205] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.323430] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.323599] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.323916] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.324097] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.324403] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 62235fd1-1cde-49a4-bd25-309752caaf29 is going to be created. [ 1127.350094] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.350582] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.350582] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.350805] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.351013] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.351265] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-62235fd1-1cde-49a4-bd25-309752caaf29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.678335] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e040c3ad-864e-4a08-8074-d3b87c80b2c3: rpc.has_security_group_logging(os_id): False [ 1127.697394] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.697550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.697629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.697849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.697970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.698169] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.698261] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.698324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.698480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.698557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.698786] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.698874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.698946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.699116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.699192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.699382] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.699477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.699560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.699825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.700019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.700019] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be created. [ 1127.768152] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.768358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.768432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.769146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.769312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.789274] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: IN_PROGRESS for 2s [ 1128.031336] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1128.031603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.468325] env[69491]: INFO networking_nsxv3.common.synchronization [req-8f1c070b-ea32-461b-8f65-e7f0676ed113 req-beb1c502-0285-4775-81f8-4502a952341b service nova] Enqueued Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_rules [ 1128.468679] env[69491]: INFO networking_nsxv3.common.synchronization [req-8f1c070b-ea32-461b-8f65-e7f0676ed113 req-beb1c502-0285-4775-81f8-4502a952341b service nova] Enqueued Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1128.468679] env[69491]: INFO networking_nsxv3.common.synchronization [req-8f1c070b-ea32-461b-8f65-e7f0676ed113 req-beb1c502-0285-4775-81f8-4502a952341b service nova] Enqueued Resource ID: 62235fd1-1cde-49a4-bd25-309752caaf29 with Priority: HIGHEST for action port [ 1128.469462] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_rules [ 1128.469753] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1128.469827] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62235fd1-1cde-49a4-bd25-309752caaf29 with Priority: HIGHEST for action port [ 1128.470808] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.471643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.471957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.472423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.472565] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.473729] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.473941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.474058] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.474301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.474598] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.474806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.474915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.475230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.475315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.475728] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.476805] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-62235fd1-1cde-49a4-bd25-309752caaf29 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.476805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62235fd1-1cde-49a4-bd25-309752caaf29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.476974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62235fd1-1cde-49a4-bd25-309752caaf29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.478284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62235fd1-1cde-49a4-bd25-309752caaf29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.478284] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62235fd1-1cde-49a4-bd25-309752caaf29',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.980947] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.981121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.981481] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.982253] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62235fd1-1cde-49a4-bd25-309752caaf29 with status ACTIVE [ 1128.982417] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.982563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.982642] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.982880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.982954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.983198] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.983336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.983412] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.983632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.983728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.983922] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.984087] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.984178] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.984332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.984412] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.984500] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62235fd1-1cde-49a4-bd25-309752caaf29 is going to be updated. [ 1129.006670] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1129.006812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.006938] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.007211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.007607] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.007607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.007745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.008981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.008981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.008981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.008981] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.012900] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.016031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.016031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.016031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.016031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.016031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62235fd1-1cde-49a4-bd25-309752caaf29" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.486898] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.511695] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.513663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.513663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.513663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.513663] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.513663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.513663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.513663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.513663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.513663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.513663] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.513663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.513663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.514173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.514173] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.514835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.514835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.514835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.514835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.514835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.515058] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.809025] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: SUCCESS [ 1129.809025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.809025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.809025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.809025] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.992029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.992029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.992029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.992029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.992029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.992029] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e is going to be created. [ 1130.017584] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.017819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.017819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.018529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.018529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.019462] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d394eeb6-7de4-4a71-8d79-c137cc55ad50: rpc.has_security_group_logging(os_id): False [ 1130.032392] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: UNINITIALIZED for 2s [ 1130.046867] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.047045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.047127] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.047332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.047448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.047631] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.047753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.047818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.048175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.048175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.048175] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.048623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.048623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.048623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.048623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.048966] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.048966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.048966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.049122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.049168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.049248] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1130.066503] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.066824] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.067042] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.067372] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.067690] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.067878] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.068018] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.068313] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.068587] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.070141] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.070141] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.070141] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.070141] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.070141] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.070141] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.070141] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.092357] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.092357] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1130.092559] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.092615] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-904" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.093079] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-4948be80-80c3-4942-b696-456830a71ee7 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.093322] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.093455] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.093857] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.094019] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4948be80-80c3-4942-b696-456830a71ee7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.119899] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.120063] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.120137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.120349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.120500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.133863] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1130.312533] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.312722] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.312776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.313036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.313221] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.313324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.313391] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.313559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.313649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.313757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.313854] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.540276] env[69491]: INFO networking_nsxv3.common.synchronization [req-6cd303c3-99ee-46f9-bca0-a299efbe8cd4 req-62fc51ec-da36-49bd-ac2c-cb7c15eee346 tempest-MultipleCreateTestJSON-326272290 tempest-MultipleCreateTestJSON-326272290-project-member] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1130.540276] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1130.540663] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.540723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.540757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.540970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.541203] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.541310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.541374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.541542] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.541630] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.541808] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.597737] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.598025] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.598181] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.598481] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.598664] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.599063] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.599240] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.599386] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.599674] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.599871] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.600221] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.600395] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.600536] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.600784] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.600933] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.602081] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 4948be80-80c3-4942-b696-456830a71ee7 is going to be updated. [ 1130.634578] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.634578] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.634578] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.634578] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.634578] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.634578] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.818456] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.818600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.023641] env[69491]: INFO networking_nsxv3.common.synchronization [req-abe7903e-a938-420f-90a1-7e2237ff5245 req-41aa3c6e-fb87-46e6-8a2c-65a420b6b087 tempest-MultipleCreateTestJSON-326272290 tempest-MultipleCreateTestJSON-326272290-project-member] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1131.024205] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGHEST for action security_group_members [ 1131.024514] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.024622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.045426] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.549421] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.675519] env[69491]: INFO networking_nsxv3.common.synchronization [req-d285a9e4-f883-4a7b-91e2-e72a7be5da71 req-e02a725e-9ea6-4686-9f38-4849b0713553 service nova] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_rules [ 1131.675794] env[69491]: INFO networking_nsxv3.common.synchronization [req-d285a9e4-f883-4a7b-91e2-e72a7be5da71 req-e02a725e-9ea6-4686-9f38-4849b0713553 service nova] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 1131.676131] env[69491]: INFO networking_nsxv3.common.synchronization [req-d285a9e4-f883-4a7b-91e2-e72a7be5da71 req-e02a725e-9ea6-4686-9f38-4849b0713553 service nova] Enqueued Resource ID: 4948be80-80c3-4942-b696-456830a71ee7 with Priority: HIGHEST for action port [ 1131.676569] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_rules [ 1131.676926] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 1131.677029] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4948be80-80c3-4942-b696-456830a71ee7 with Priority: HIGHEST for action port [ 1131.677943] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.678126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.678225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.678631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.678631] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.679775] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.683080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.683080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.683080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.683080] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.683080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.683080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.683080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.683080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.683080] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.683080] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-4948be80-80c3-4942-b696-456830a71ee7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.683080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.683080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.683491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.683491] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4948be80-80c3-4942-b696-456830a71ee7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.045148] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: SUCCESS [ 1132.045148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.045148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.045148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.045148] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.045148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.045148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.046950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.047079] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.047190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.047284] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.055044] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.055044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.055044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.055044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.055044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.055044] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be updated. [ 1132.088259] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.088587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.088782] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.089186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.089468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.100088] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: IN_PROGRESS for 2s [ 1132.148420] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1132.148649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.189729] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.190072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.190369] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.191591] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4948be80-80c3-4942-b696-456830a71ee7 with status ACTIVE [ 1132.191894] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.192618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.192755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.193255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.193355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.194034] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.194034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.194034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.194334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.194442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.194755] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.194908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.195041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.195299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.195443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.195648] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4948be80-80c3-4942-b696-456830a71ee7 is going to be updated. [ 1132.226091] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.226312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.226312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.226475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.226642] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.226859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4948be80-80c3-4942-b696-456830a71ee7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.550092] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.550441] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.550441] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.550736] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.550922] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.551038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.551106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.551269] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.551359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.551449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.551600] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.551719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.551792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.551950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.552591] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.552591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.552591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.552591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.552591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.552788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.552788] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.661891] env[69491]: INFO networking_nsxv3.common.synchronization [None req-b40d9a22-d47e-4285-912c-5cfa405577a4 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGHEST for action security_group_rules [ 1132.662492] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGHEST for action security_group_rules [ 1132.662891] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2757bc9-a946-4a06-ad40-4649502b2e59 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.663012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.663089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.663506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.663506] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2757bc9-a946-4a06-ad40-4649502b2e59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.698868] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.816337] env[69491]: INFO networking_nsxv3.common.synchronization [None req-a3dbdaa0-10d1-4550-96c8-176468230010 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGHEST for action security_group_rules [ 1132.817088] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGHEST for action security_group_rules [ 1132.817525] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2757bc9-a946-4a06-ad40-4649502b2e59 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.817615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.057687] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cc2812f-6296-4ced-a800-c6fb38741a8e: rpc.has_security_group_logging(os_id): False [ 1133.078888] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.079146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.079232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.079600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.079600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.079806] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.079890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.079931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.080115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.080174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.080410] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.080493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.080565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.080709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.080785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.081386] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.082057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.082057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.082057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.082211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.082211] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e is going to be created. [ 1133.152966] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.152966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.152966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.153324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.153324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.164593] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: IN_PROGRESS for 2s [ 1133.192536] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.192704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.192806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.193117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.193225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.193330] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2757bc9-a946-4a06-ad40-4649502b2e59 already deleted. [ 1133.193419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.193581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.193750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.193855] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2757bc9-a946-4a06-ad40-4649502b2e59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.202261] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.202463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.202573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.203545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.203545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.203545] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be updated. [ 1133.260514] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.260709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.260777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.261186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.261436] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.272074] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: IN_PROGRESS for 2s [ 1133.716353] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.716353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.716353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.716868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.716868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.716868] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2757bc9-a946-4a06-ad40-4649502b2e59 already deleted. [ 1133.716868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.110612] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: SUCCESS [ 1134.110829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.111122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.111380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.111967] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.111967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.111967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.111967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.112268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.112268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.112355] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.112489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.112524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.112713] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.112863] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.112967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.113066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.113260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.113358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.113436] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.113539] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.115210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.115210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.115210] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.115371] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.115371] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.115469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.115533] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.115626] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.617730] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e040c3ad-864e-4a08-8074-d3b87c80b2c3: rpc.has_security_group_logging(os_id): False [ 1134.619206] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.619353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.619412] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.619619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.619728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.619932] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.620068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.620134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.620293] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.620370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.620457] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be updated. [ 1134.641581] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.641984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.642640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.642640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.642761] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.643009] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.643134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.643202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.643406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.643495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.643895] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.643895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.643895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.644129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.644224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.644775] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.644775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.644775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.644775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.645083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.645083] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be updated. [ 1134.653534] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.653795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.653795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.653937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.654117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.663526] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: IN_PROGRESS for 2s [ 1134.711359] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.711538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.711620] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.711871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.712059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.726298] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: IN_PROGRESS for 2s [ 1135.183696] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: SUCCESS [ 1135.183931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.283126] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 1135.283459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.283959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.284488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.284488] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.284488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.284488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.284763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.284763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.284906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.284906] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.788057] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.788057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.788057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.788057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.788057] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.788057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.788057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.788057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.788813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.788813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.788813] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.788813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.788813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.789223] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.789421] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.789724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.789859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.790039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.790155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.790273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.790412] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.292598] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9632268c-db1a-4548-9652-b638bc84b886: rpc.has_security_group_logging(os_id): False [ 1136.312265] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.312415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.312509] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.312987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.312987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.313146] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.313308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.313308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.313390] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.313450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.313746] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.313860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.313930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.314106] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.314199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.314423] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.314522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.314596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.314729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.314807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.314893] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be updated. [ 1136.380695] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.380857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.380975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.381175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.381328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.397215] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: IN_PROGRESS for 2s [ 1136.675816] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: SUCCESS [ 1136.676144] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 deletion is rescheduled due to dependency. [ 1136.676252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.742094] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 in Status: SUCCESS [ 1136.742363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.818019] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1137.818325] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1138.413442] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 1138.414177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.741309] env[69491]: INFO networking_nsxv3.common.synchronization [req-b43512d2-ca4f-4965-a674-6607b2f0be12 req-4655adc6-a731-41b3-804a-7799a1148627 tempest-ServerActionsTestOtherB-761111206 tempest-ServerActionsTestOtherB-761111206-project-member] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 1138.741874] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 1138.742203] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.742318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.742390] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.742628] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.743934] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.743934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.743934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.746691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.746824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.746955] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.781686] env[69491]: INFO networking_nsxv3.common.synchronization [req-eee794e3-d314-45d4-8480-eba136aaf258 req-3f7c55ce-941b-4528-8db4-cac1a39404ae tempest-AttachVolumeTestJSON-1247015010 tempest-AttachVolumeTestJSON-1247015010-project-member] Enqueued Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGHEST for action security_group_members [ 1138.782152] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGHEST for action security_group_members [ 1138.782401] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-796dade6-def8-42b0-adbd-7347623ab0c8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.782524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.782599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.782817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.783958] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.784124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.784197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.784377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.784468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.784565] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.251130] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.252110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.252110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.252110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.252110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.252361] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.252525] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.252629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.252836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.252924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.253056] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 1139.257423] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.257770] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.257973] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.258552] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.260022] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.260022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.260022] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.260186] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.260343] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.260559] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.260674] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.260836] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.260997] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.261152] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.261268] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.261435] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.287111] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.288293] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.288293] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.288293] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.288293] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-de7c92e2-bc02-4693-a264-d2038b95cfc2 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.288546] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.288546] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.289555] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.289555] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de7c92e2-bc02-4693-a264-d2038b95cfc2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.291065] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.291065] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.291065] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.291065] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.291265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.291297] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.291390] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.291455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.291791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.291791] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.291791] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 796dade6-def8-42b0-adbd-7347623ab0c8 is going to be updated. [ 1139.294504] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.294504] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.294504] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.294703] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.295223] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.304957] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 1139.323139] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.323139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.323139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.323139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.323139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.330295] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 796dade6-def8-42b0-adbd-7347623ab0c8 in Status: IN_PROGRESS for 2s [ 1139.792166] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.792366] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.793058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.793058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.793058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.793270] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port de7c92e2-bc02-4693-a264-d2038b95cfc2 not found, creating... [ 1139.793446] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.793612] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.793738] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.793976] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.794136] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.794430] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.794596] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.794721] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.794944] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.795099] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.795246] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: de7c92e2-bc02-4693-a264-d2038b95cfc2 is going to be created. [ 1139.817321] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.817543] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.817662] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.817957] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.818209] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.818446] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.533773] env[69491]: INFO networking_nsxv3.common.synchronization [req-b43512d2-ca4f-4965-a674-6607b2f0be12 req-e0572246-3f7a-4588-9b4f-63ffa778fd18 service nova] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_rules [ 1140.536964] env[69491]: INFO networking_nsxv3.common.synchronization [req-b43512d2-ca4f-4965-a674-6607b2f0be12 req-e0572246-3f7a-4588-9b4f-63ffa778fd18 service nova] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 1140.536964] env[69491]: INFO networking_nsxv3.common.synchronization [req-b43512d2-ca4f-4965-a674-6607b2f0be12 req-e0572246-3f7a-4588-9b4f-63ffa778fd18 service nova] Enqueued Resource ID: de7c92e2-bc02-4693-a264-d2038b95cfc2 with Priority: HIGHEST for action port [ 1140.536964] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_rules [ 1140.536964] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 1140.536964] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de7c92e2-bc02-4693-a264-d2038b95cfc2 with Priority: HIGHEST for action port [ 1140.537595] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.537747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.537809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.538036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.538122] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.539762] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.539906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.540202] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-de7c92e2-bc02-4693-a264-d2038b95cfc2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.540331] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.540417] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.540621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.540768] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de7c92e2-bc02-4693-a264-d2038b95cfc2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.044025] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de7c92e2-bc02-4693-a264-d2038b95cfc2 with status ACTIVE [ 1141.044279] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.044418] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.044488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.044870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.044870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.045074] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.045181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.045250] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.045399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.045481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.045664] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.045755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.045806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.045949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.046036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.046122] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de7c92e2-bc02-4693-a264-d2038b95cfc2 is going to be updated. [ 1141.047306] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.047437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.068076] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.068239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.068423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.068478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.068766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.068855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.316914] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 1141.316914] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 deletion is rescheduled due to dependency. [ 1141.316914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.316914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.316914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.316914] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.316914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.316914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.316914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.316914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.316914] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.339131] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 796dade6-def8-42b0-adbd-7347623ab0c8 in Status: SUCCESS [ 1141.339131] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 796dade6-def8-42b0-adbd-7347623ab0c8 deletion is rescheduled due to dependency. [ 1141.339131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.744889] env[69491]: INFO networking_nsxv3.common.synchronization [None req-34b3103c-6930-4dbe-a100-0bad6228453a None None] Enqueued Resource ID: 088437c6-6ea9-4d43-bc20-6dc20f6821fd with Priority: HIGHEST for action port [ 1141.745269] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 088437c6-6ea9-4d43-bc20-6dc20f6821fd with Priority: HIGHEST for action port [ 1141.745764] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-088437c6-6ea9-4d43-bc20-6dc20f6821fd taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.746078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-088437c6-6ea9-4d43-bc20-6dc20f6821fd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.747667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-088437c6-6ea9-4d43-bc20-6dc20f6821fd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.747667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-088437c6-6ea9-4d43-bc20-6dc20f6821fd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.747667] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('088437c6-6ea9-4d43-bc20-6dc20f6821fd',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.819574] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.249427] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 088437c6-6ea9-4d43-bc20-6dc20f6821fd [ 1142.250948] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.250948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.250948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.250948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.250948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.250948] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:088437c6-6ea9-4d43-bc20-6dc20f6821fd already deleted. [ 1142.250948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-088437c6-6ea9-4d43-bc20-6dc20f6821fd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.324538] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.826454] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.826827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.826827] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.827013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.827079] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.827201] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 1142.861073] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.861266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.861306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.861505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.861654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.872547] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 1144.258330] env[69491]: INFO networking_nsxv3.common.synchronization [None req-f6d39053-68f4-4aa7-b78e-352ed4e2a9d7 None None] Enqueued Resource ID: fcbb3a9e-f1a5-451e-bc29-2b87c5194491 with Priority: HIGHEST for action port [ 1144.259323] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcbb3a9e-f1a5-451e-bc29-2b87c5194491 with Priority: HIGHEST for action port [ 1144.259809] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcbb3a9e-f1a5-451e-bc29-2b87c5194491 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.260089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcbb3a9e-f1a5-451e-bc29-2b87c5194491" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.260271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcbb3a9e-f1a5-451e-bc29-2b87c5194491" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.260646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcbb3a9e-f1a5-451e-bc29-2b87c5194491" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.260800] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcbb3a9e-f1a5-451e-bc29-2b87c5194491',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.763576] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fcbb3a9e-f1a5-451e-bc29-2b87c5194491 [ 1144.764014] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.764014] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.764213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.764328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.764448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.764512] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fcbb3a9e-f1a5-451e-bc29-2b87c5194491 already deleted. [ 1144.764613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcbb3a9e-f1a5-451e-bc29-2b87c5194491" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.885648] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 1144.886064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.886366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.886727] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.887259] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.887259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.887411] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.887510] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.887637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.887764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.887895] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.392326] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.897793] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fd20800-5a4b-495c-a02a-35b10f00ea55: rpc.has_security_group_logging(os_id): False [ 1145.918346] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.918553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.918658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.918883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.918979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.919245] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.919350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.919415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.919595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.919677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.919767] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 1145.985973] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.986217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.986217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.986326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.986634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.000449] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 1146.063213] env[69491]: INFO networking_nsxv3.common.synchronization [req-1f35ae83-7e1f-4d55-a14c-8dc3af84514f req-408ccbdd-54e3-4be6-bfbd-7982e970fefd tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1146.065575] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1146.065575] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.065575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.065575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.065575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.065575] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.065575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.065575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.065575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.065575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.065938] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.339734] env[69491]: INFO networking_nsxv3.common.synchronization [req-d692d6b6-50b2-4412-86f5-1a89d4f4c848 req-0887951f-a8d6-44f2-8824-3c395fa0fe33 tempest-DeleteServersTestJSON-1018355336 tempest-DeleteServersTestJSON-1018355336-project-member] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1146.340243] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1146.340539] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.340671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.340719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.340921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.341078] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.341193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.341239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.341381] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.341459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.341892] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.505052] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.505052] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.505052] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.505052] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.505522] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.505522] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.505522] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.505706] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.505859] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.506188] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1146.506351] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.506561] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.506727] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.506893] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1146.507052] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.507231] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.530799] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.530799] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1146.530799] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.530799] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.530799] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-ef0c97db-fb6b-448e-ae9a-0a11b08bcadf taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.530799] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-ef0c97db-fb6b-448e-ae9a-0a11b08bcadf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.530799] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-ef0c97db-fb6b-448e-ae9a-0a11b08bcadf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.531319] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-ef0c97db-fb6b-448e-ae9a-0a11b08bcadf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.531319] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef0c97db-fb6b-448e-ae9a-0a11b08bcadf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.568146] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.843295] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.843471] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.843544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.843903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.844026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.844259] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.844419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.844554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.844813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.844887] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.844980] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1146.872314] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.872465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.872530] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.872740] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.872896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.880931] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1147.035191] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.035652] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.035652] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.036018] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.036223] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.036630] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port ef0c97db-fb6b-448e-ae9a-0a11b08bcadf not found, creating... [ 1147.036815] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.037013] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.037181] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.037475] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.037790] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.038072] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.038288] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.038449] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.038736] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.038912] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.039106] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: ef0c97db-fb6b-448e-ae9a-0a11b08bcadf is going to be created. [ 1147.060989] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.061162] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.061357] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.061939] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.062307] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.062500] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-ef0c97db-fb6b-448e-ae9a-0a11b08bcadf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.069989] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.572994] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.573279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.573279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.573573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.573573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.573712] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1147.606261] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.606413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.606476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.606705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.606854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.621097] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1147.893211] env[69491]: INFO networking_nsxv3.common.synchronization [req-fa88e804-4aa4-4e02-8b96-007b5faf2359 req-0171b338-d40a-45bc-9a33-9459e2be8d33 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGHEST for action security_group_members [ 1147.893802] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGHEST for action security_group_members [ 1147.898474] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2757bc9-a946-4a06-ad40-4649502b2e59 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.898634] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.898715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.899023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.899210] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.899343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.899421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.899566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.899650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.899748] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2757bc9-a946-4a06-ad40-4649502b2e59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.937972] env[69491]: INFO networking_nsxv3.common.synchronization [req-1f35ae83-7e1f-4d55-a14c-8dc3af84514f req-e0ddf146-3c2c-45df-9bf1-5070bb52837a service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 1147.940656] env[69491]: INFO networking_nsxv3.common.synchronization [req-1f35ae83-7e1f-4d55-a14c-8dc3af84514f req-e0ddf146-3c2c-45df-9bf1-5070bb52837a service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1147.941328] env[69491]: INFO networking_nsxv3.common.synchronization [req-1f35ae83-7e1f-4d55-a14c-8dc3af84514f req-e0ddf146-3c2c-45df-9bf1-5070bb52837a service nova] Enqueued Resource ID: ef0c97db-fb6b-448e-ae9a-0a11b08bcadf with Priority: HIGHEST for action port [ 1147.941950] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 1147.942311] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1147.943020] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0c97db-fb6b-448e-ae9a-0a11b08bcadf with Priority: HIGHEST for action port [ 1147.943182] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.943573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.943573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.944351] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.944573] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.945905] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.946241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.951019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef0c97db-fb6b-448e-ae9a-0a11b08bcadf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.951019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef0c97db-fb6b-448e-ae9a-0a11b08bcadf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.951019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef0c97db-fb6b-448e-ae9a-0a11b08bcadf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.951019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef0c97db-fb6b-448e-ae9a-0a11b08bcadf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.951019] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef0c97db-fb6b-448e-ae9a-0a11b08bcadf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.015634] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 1148.015878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.234263] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.234520] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.234704] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.235055] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.235446] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.235694] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.235898] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.236114] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.236310] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.236569] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.236724] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.236851] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.236979] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.237151] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.237288] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.237426] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.266608] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.266814] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1148.266964] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.267196] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.267532] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-c50721d6-ada4-4509-b674-1095fb39f9f4 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.268057] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-c50721d6-ada4-4509-b674-1095fb39f9f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.268057] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-c50721d6-ada4-4509-b674-1095fb39f9f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.268224] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-c50721d6-ada4-4509-b674-1095fb39f9f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.268373] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c50721d6-ada4-4509-b674-1095fb39f9f4',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.402522] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.402699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.403092] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.403092] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.403209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.403389] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.403847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.403847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.403847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.403847] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.404095] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2757bc9-a946-4a06-ad40-4649502b2e59 already deleted. [ 1148.404095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.449583] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.449731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.449981] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef0c97db-fb6b-448e-ae9a-0a11b08bcadf with status ACTIVE [ 1148.450707] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.450707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.450707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.450707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.450707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.451070] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.451070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.451070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.451234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.451361] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.451535] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.451629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.451691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.451854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.451941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.452041] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef0c97db-fb6b-448e-ae9a-0a11b08bcadf is going to be updated. [ 1148.486987] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.487173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.487329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.487579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.487752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.488297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef0c97db-fb6b-448e-ae9a-0a11b08bcadf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.770978] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.771378] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.771378] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.772114] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.772306] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.772534] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port c50721d6-ada4-4509-b674-1095fb39f9f4 not found, creating... [ 1148.772833] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.773013] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.773154] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.773408] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.773581] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.773888] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.774298] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.774492] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.774754] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.774930] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.775712] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: c50721d6-ada4-4509-b674-1095fb39f9f4 is going to be created. [ 1148.796235] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.796540] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.796664] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.796959] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.797212] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.797450] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-c50721d6-ada4-4509-b674-1095fb39f9f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.889879] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1148.890045] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d deletion is rescheduled due to dependency. [ 1148.890143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.496992] env[69491]: INFO networking_nsxv3.common.synchronization [req-aef757ba-eae7-4f6c-be9a-1b4cd3eb465c req-c8b2c5b3-7709-4dd8-9095-997c207c8872 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_members [ 1149.497544] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_members [ 1149.497846] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.497970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.498051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.498264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.498460] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.498539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.498613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.498775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.498861] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.498959] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.633355] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1149.633600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.634551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.634679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.634824] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.635170] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.635170] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.635299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.635397] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.635530] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.004728] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.004728] env[69491]: INFO networking_nsxv3.common.synchronization [req-fa88e804-4aa4-4e02-8b96-007b5faf2359 req-7cdcc599-bec4-4300-a27f-28f6bb10c193 service nova] Enqueued Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGHEST for action security_group_rules [ 1150.004728] env[69491]: INFO networking_nsxv3.common.synchronization [req-fa88e804-4aa4-4e02-8b96-007b5faf2359 req-7cdcc599-bec4-4300-a27f-28f6bb10c193 service nova] Enqueued Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGHEST for action security_group_members [ 1150.005258] env[69491]: INFO networking_nsxv3.common.synchronization [req-fa88e804-4aa4-4e02-8b96-007b5faf2359 req-7cdcc599-bec4-4300-a27f-28f6bb10c193 service nova] Enqueued Resource ID: c50721d6-ada4-4509-b674-1095fb39f9f4 with Priority: HIGHEST for action port [ 1150.005387] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGHEST for action security_group_rules [ 1150.005521] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGHEST for action security_group_members [ 1150.005659] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50721d6-ada4-4509-b674-1095fb39f9f4 with Priority: HIGHEST for action port [ 1150.005970] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2757bc9-a946-4a06-ad40-4649502b2e59 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.008809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.008809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.008809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.008809] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2757bc9-a946-4a06-ad40-4649502b2e59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.009076] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2757bc9-a946-4a06-ad40-4649502b2e59 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.009204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.009245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.009442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.009631] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.009733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.009801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.011509] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.011509] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.011509] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2757bc9-a946-4a06-ad40-4649502b2e59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.011773] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-c50721d6-ada4-4509-b674-1095fb39f9f4 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.011919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c50721d6-ada4-4509-b674-1095fb39f9f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.012018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c50721d6-ada4-4509-b674-1095fb39f9f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.012505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c50721d6-ada4-4509-b674-1095fb39f9f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.012598] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c50721d6-ada4-4509-b674-1095fb39f9f4',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.139846] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.503854] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.514655] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2757bc9-a946-4a06-ad40-4649502b2e59 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.515076] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.515076] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2757bc9-a946-4a06-ad40-4649502b2e59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.517435] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c50721d6-ada4-4509-b674-1095fb39f9f4 with status ACTIVE [ 1150.517666] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.517797] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.517867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.518174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.518245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.518368] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.518790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.518907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.519102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.519184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.519375] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.519501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.519567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.519742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.519788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.519872] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c50721d6-ada4-4509-b674-1095fb39f9f4 is going to be updated. [ 1150.568219] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.568390] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.570019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.570019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.570019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.570019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c50721d6-ada4-4509-b674-1095fb39f9f4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.644049] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.816474] env[69491]: INFO networking_nsxv3.common.synchronization [req-48490346-5005-4563-970c-ef40627b637e req-b36c7f5b-8a06-4e5c-92e0-7dc52a77b470 tempest-ImagesOneServerNegativeTestJSON-656208746 tempest-ImagesOneServerNegativeTestJSON-656208746-project-member] Enqueued Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1150.817640] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1150.817780] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.817901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.817969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.818177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.818335] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.818864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.818864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.818864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.818864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.818864] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.008340] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.008949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.008949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.008949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.008949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.009185] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 is going to be updated. [ 1151.017848] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2757bc9-a946-4a06-ad40-4649502b2e59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.043484] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.043689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.043729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.043965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.044128] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.054215] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: IN_PROGRESS for 2s [ 1151.146578] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.146906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.147075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.147434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.147553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.147650] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1151.191182] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.191345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.191416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.191672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.191935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.203333] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1151.321632] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.321797] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.321866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.322133] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.322225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.322431] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.322523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.322596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.322741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.322883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.322883] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e is going to be updated. [ 1151.351925] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.352166] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.352166] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.352251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.353150] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.367389] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: IN_PROGRESS for 2s [ 1151.520752] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.520939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.521052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.521311] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.521408] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.521511] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2757bc9-a946-4a06-ad40-4649502b2e59 is going to be created. [ 1151.552383] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.552687] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.552687] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.552831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.552963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.566478] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2757bc9-a946-4a06-ad40-4649502b2e59 in Status: UNINITIALIZED for 2s [ 1153.065359] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: SUCCESS [ 1153.065652] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.212907] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1153.213227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.213462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.213747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.214031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.214199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.214288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.214511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.214617] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.214745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.214881] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.381884] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: SUCCESS [ 1153.381884] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e deletion is rescheduled due to dependency. [ 1153.382175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.579930] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2757bc9-a946-4a06-ad40-4649502b2e59 in Status: SUCCESS [ 1153.580218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.580410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.580653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.580882] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.581018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.581098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.581264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.581347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.581439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.581549] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2757bc9-a946-4a06-ad40-4649502b2e59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.787153] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.787387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.787387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.787572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.787730] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.787829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.787891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.788054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.788140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.788224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.788418] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.788549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.788549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.788685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.788819] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.788909] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.788969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.789122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.789198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.789277] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.789366] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.083784] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2757bc9-a946-4a06-ad40-4649502b2e59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.291712] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d394eeb6-7de4-4a71-8d79-c137cc55ad50: rpc.has_security_group_logging(os_id): False [ 1154.313302] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.313479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.313540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.313731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.313824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.314055] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.314160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.314224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.314377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.314455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.314632] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.314724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.314786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.314924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.314995] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.315205] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.315301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.315362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.315503] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.315577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.315662] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1154.379981] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.380174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.380229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.380455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.380635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.396792] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1154.586685] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2757bc9-a946-4a06-ad40-4649502b2e59: rpc.has_security_group_logging(os_id): False [ 1154.607577] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.607577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.607577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.607790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.607790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.607958] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.608084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.608151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.608308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.608448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.608532] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2757bc9-a946-4a06-ad40-4649502b2e59 is going to be created. [ 1154.683020] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.683327] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.683327] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.683530] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.683666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.700627] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2757bc9-a946-4a06-ad40-4649502b2e59 in Status: IN_PROGRESS for 2s [ 1155.818655] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1155.818982] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1156.412536] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1156.412536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.714914] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2757bc9-a946-4a06-ad40-4649502b2e59 in Status: SUCCESS [ 1156.715160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.870991] env[69491]: INFO networking_nsxv3.common.synchronization [req-b71ca4e8-1397-4bd8-8a07-354b63b4312a req-e3bca106-66c0-4145-88be-068e1f275eaa tempest-InstanceActionsNegativeTestJSON-1607970013 tempest-InstanceActionsNegativeTestJSON-1607970013-project-member] Enqueued Resource ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd with Priority: HIGHEST for action security_group_members [ 1156.871344] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd with Priority: HIGHEST for action security_group_members [ 1156.871443] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.871582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.871631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.871894] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.872062] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.872172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.872263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.872469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.872585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.872691] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.222036] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.222298] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-941" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.222438] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-941" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.223515] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-941" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.223862] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.224091] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.224264] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.224582] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.224756] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.224997] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.225159] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.225345] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.225429] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.225581] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.225712] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.225862] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.253302] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.253537] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1157.253642] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.253860] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-941" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.254315] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-36b5b85d-020c-44c6-96dc-d800d524a2fc taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.254450] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-36b5b85d-020c-44c6-96dc-d800d524a2fc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.254586] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-36b5b85d-020c-44c6-96dc-d800d524a2fc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.254987] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-36b5b85d-020c-44c6-96dc-d800d524a2fc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.255156] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36b5b85d-020c-44c6-96dc-d800d524a2fc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.375960] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.376323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.376447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.376758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.377333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.377333] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.377477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.377477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.377889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.377889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.377956] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd already deleted. [ 1157.378103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.757586] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.757960] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.758079] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.758405] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.758658] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.758847] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 36b5b85d-020c-44c6-96dc-d800d524a2fc not found, creating... [ 1157.759155] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.759368] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.759578] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.759939] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.760218] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.760730] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.761018] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.761257] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.761619] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.761872] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.762172] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 36b5b85d-020c-44c6-96dc-d800d524a2fc is going to be created. [ 1157.784848] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.785067] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.785209] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.785529] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.785771] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.786028] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-36b5b85d-020c-44c6-96dc-d800d524a2fc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.476781] env[69491]: INFO networking_nsxv3.common.synchronization [req-b71ca4e8-1397-4bd8-8a07-354b63b4312a req-fea499ca-6527-4eeb-858a-3e492fa624d1 service nova] Enqueued Resource ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd with Priority: HIGHEST for action security_group_rules [ 1158.477159] env[69491]: INFO networking_nsxv3.common.synchronization [req-b71ca4e8-1397-4bd8-8a07-354b63b4312a req-fea499ca-6527-4eeb-858a-3e492fa624d1 service nova] Enqueued Resource ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd with Priority: HIGHEST for action security_group_members [ 1158.477159] env[69491]: INFO networking_nsxv3.common.synchronization [req-b71ca4e8-1397-4bd8-8a07-354b63b4312a req-fea499ca-6527-4eeb-858a-3e492fa624d1 service nova] Enqueued Resource ID: 36b5b85d-020c-44c6-96dc-d800d524a2fc with Priority: HIGHEST for action port [ 1158.477302] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd with Priority: HIGHEST for action security_group_rules [ 1158.477450] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd with Priority: HIGHEST for action security_group_members [ 1158.477524] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b5b85d-020c-44c6-96dc-d800d524a2fc with Priority: HIGHEST for action port [ 1158.479631] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.479865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.479865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.480182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.480248] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.481452] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.481576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.481645] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.481822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.481983] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.482097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.482160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.482309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.482398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.482491] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.483334] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-36b5b85d-020c-44c6-96dc-d800d524a2fc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.483448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36b5b85d-020c-44c6-96dc-d800d524a2fc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.483508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36b5b85d-020c-44c6-96dc-d800d524a2fc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.483702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36b5b85d-020c-44c6-96dc-d800d524a2fc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.483755] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36b5b85d-020c-44c6-96dc-d800d524a2fc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.985950] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.987102] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.987262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.987376] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36b5b85d-020c-44c6-96dc-d800d524a2fc with status ACTIVE [ 1158.987537] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.987635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.987706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.987935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.987988] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.988172] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.988272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.988350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.988512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.988593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.988782] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.988875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.988936] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.989150] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.989183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.989239] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36b5b85d-020c-44c6-96dc-d800d524a2fc is going to be updated. [ 1159.010866] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.011030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.011109] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.011300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.011632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.011839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36b5b85d-020c-44c6-96dc-d800d524a2fc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.491421] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.993779] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.994015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.994107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.994333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.994453] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.994529] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd is going to be created. [ 1160.022246] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.022465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.022465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.022644] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.022801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.033974] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd in Status: UNINITIALIZED for 2s [ 1161.628058] env[69491]: INFO networking_nsxv3.common.synchronization [req-980ad482-c5ac-4a98-8e8c-74e59f7dab18 req-9e4119cb-ebe6-4b77-b229-6a264ce61867 tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1161.628456] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1161.628850] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.629018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.629081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.629433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.629491] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.629600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.630225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.630225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.630225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.630225] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.045666] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd in Status: SUCCESS [ 1162.045912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.046099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.046377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.046585] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.046710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.046789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.046935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.047032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.047123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.047213] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.132573] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.550169] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.550343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.550423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.550651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.550830] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.550935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.550998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.551221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.551256] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.551337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.551487] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.551579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.551635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.551778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.551911] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.552010] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.552074] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.552209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.552284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.552364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.552450] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.636093] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.054662] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd: rpc.has_security_group_logging(os_id): False [ 1163.072464] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.072660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.072728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.072959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.073055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.073265] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.073366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.073450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.073637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.073742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.073960] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.074072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.074135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.074284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.074383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.074581] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.074673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.074726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.074903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.074986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.075085] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd is going to be created. [ 1163.131814] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.132310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.132310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.132310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.132545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.137161] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.137284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.137358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.137565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.137711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.137778] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1163.147651] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd in Status: IN_PROGRESS for 2s [ 1163.174074] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.174355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.174355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.174485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.174712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.193830] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1164.920877] env[69491]: INFO networking_nsxv3.common.synchronization [None req-97ad9b3d-fb5d-4da9-97f2-1e8a9c0e482d tempest-ImagesOneServerNegativeTestJSON-656208746 tempest-ImagesOneServerNegativeTestJSON-656208746-project-member] Enqueued Resource ID: e75ba00c-3b41-4f5b-82ed-2c9531a23265 with Priority: HIGHEST for action security_group_rules [ 1164.921232] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e75ba00c-3b41-4f5b-82ed-2c9531a23265 with Priority: HIGHEST for action security_group_rules [ 1164.921730] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e75ba00c-3b41-4f5b-82ed-2c9531a23265 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.921730] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e75ba00c-3b41-4f5b-82ed-2c9531a23265" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.921730] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e75ba00c-3b41-4f5b-82ed-2c9531a23265" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.921906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e75ba00c-3b41-4f5b-82ed-2c9531a23265" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.921941] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e75ba00c-3b41-4f5b-82ed-2c9531a23265',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.029784] env[69491]: INFO networking_nsxv3.common.synchronization [None req-86f4e417-0836-4861-aca1-c53bb3ea8005 tempest-ImagesOneServerNegativeTestJSON-656208746 tempest-ImagesOneServerNegativeTestJSON-656208746-project-member] Enqueued Resource ID: e75ba00c-3b41-4f5b-82ed-2c9531a23265 with Priority: HIGHEST for action security_group_rules [ 1165.030636] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e75ba00c-3b41-4f5b-82ed-2c9531a23265 with Priority: HIGHEST for action security_group_rules [ 1165.031636] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e75ba00c-3b41-4f5b-82ed-2c9531a23265 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.031636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e75ba00c-3b41-4f5b-82ed-2c9531a23265" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.161260] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd in Status: SUCCESS [ 1165.161554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.204552] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1165.204890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.450261] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.450261] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.450261] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.450689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.450689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.450750] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e75ba00c-3b41-4f5b-82ed-2c9531a23265 already deleted. [ 1165.450948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e75ba00c-3b41-4f5b-82ed-2c9531a23265" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.451141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e75ba00c-3b41-4f5b-82ed-2c9531a23265" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.451177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e75ba00c-3b41-4f5b-82ed-2c9531a23265" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.451423] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e75ba00c-3b41-4f5b-82ed-2c9531a23265',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.669736] env[69491]: INFO networking_nsxv3.common.synchronization [req-b78c59c3-4850-4cc7-9a1c-be9496a868b8 req-ce478548-14cb-4323-a132-528467675c11 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_members [ 1165.670243] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGHEST for action security_group_members [ 1165.670571] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.670700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.671784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.676026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.676026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.676026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.676026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.676026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.676026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.676026] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.973968] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.973968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.973968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.973968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.973968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.973968] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e75ba00c-3b41-4f5b-82ed-2c9531a23265 already deleted. [ 1165.973968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e75ba00c-3b41-4f5b-82ed-2c9531a23265" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.177835] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.178016] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.178086] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.178449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.178585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.178803] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.178928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.178963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.179163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.179265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.179377] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 is going to be updated. [ 1166.224578] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.224850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.224850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.225121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.225278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.235502] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: IN_PROGRESS for 2s [ 1168.250016] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 in Status: SUCCESS [ 1168.250326] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 deletion is rescheduled due to dependency. [ 1168.250392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.671097] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1170.671518] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1171.603175] env[69491]: INFO networking_nsxv3.common.synchronization [None req-cab5a716-0031-4857-b0e4-79e559ed3602 None None] Enqueued Resource ID: d9b62f45-b93f-49b7-b9d9-4224c1c0d10a with Priority: HIGHEST for action port [ 1171.603850] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b62f45-b93f-49b7-b9d9-4224c1c0d10a with Priority: HIGHEST for action port [ 1171.604285] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9b62f45-b93f-49b7-b9d9-4224c1c0d10a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.604362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9b62f45-b93f-49b7-b9d9-4224c1c0d10a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.604446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9b62f45-b93f-49b7-b9d9-4224c1c0d10a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.604793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9b62f45-b93f-49b7-b9d9-4224c1c0d10a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.604793] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9b62f45-b93f-49b7-b9d9-4224c1c0d10a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.108672] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9b62f45-b93f-49b7-b9d9-4224c1c0d10a [ 1172.108672] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.108672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.108672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.108672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.108672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.108672] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9b62f45-b93f-49b7-b9d9-4224c1c0d10a already deleted. [ 1172.108672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9b62f45-b93f-49b7-b9d9-4224c1c0d10a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.310808] env[69491]: INFO networking_nsxv3.common.synchronization [None req-8e824047-50dd-45c3-8598-3bef2166798b tempest-AttachVolumeShelveTestJSON-1615643752 tempest-AttachVolumeShelveTestJSON-1615643752-project-member] Enqueued Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_rules [ 1172.313868] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_rules [ 1172.313868] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.313868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.313868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.313868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.313868] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.392627] env[69491]: INFO networking_nsxv3.common.synchronization [None req-381bee2e-9032-48cc-8d6f-a34c720f1c1b tempest-AttachVolumeShelveTestJSON-1615643752 tempest-AttachVolumeShelveTestJSON-1615643752-project-member] Enqueued Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_rules [ 1172.395855] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_rules [ 1172.396514] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.396514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.835913] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.836286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.836286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.836442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.836476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.836580] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da83f74d-33e1-4838-a0f1-70f509a0a68c already deleted. [ 1172.836665] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.836817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.836966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.837070] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.177026] env[69491]: INFO networking_nsxv3.common.synchronization [req-7feb70c6-931e-4172-bd46-0bc1d0e20bb1 req-fa003637-c03e-49e5-82e0-c3f8f15d8fb7 tempest-DeleteServersTestJSON-1018355336 tempest-DeleteServersTestJSON-1018355336-project-member] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1173.177026] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1173.177026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.177026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.177026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.177692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.177963] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.178344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.178518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.179365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.179580] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.179814] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.279544] env[69491]: INFO networking_nsxv3.common.synchronization [req-90958a6b-4729-449f-b8f7-4b3a7677c1ba req-51744369-0a43-4e94-aff4-6c47a3b4da23 tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1173.279544] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1173.279544] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.279544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.279544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.280439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.280778] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.281514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.281687] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.281985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.282224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.283411] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.358881] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.359138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.359138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.359626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.359626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.359705] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da83f74d-33e1-4838-a0f1-70f509a0a68c already deleted. [ 1173.359749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.644084] env[69491]: INFO networking_nsxv3.common.synchronization [req-8490259a-d1d7-45f9-b399-a321d1a593b7 req-8957b6cb-ea93-4b8b-aa66-ffb38979ae82 tempest-InstanceActionsNegativeTestJSON-1607970013 tempest-InstanceActionsNegativeTestJSON-1607970013-project-member] Enqueued Resource ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd with Priority: HIGHEST for action security_group_members [ 1173.646688] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd with Priority: HIGHEST for action security_group_members [ 1173.648235] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.651024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.651024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.651024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.651024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.651024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.651024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.651024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.651024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.651024] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.686928] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.686928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.686928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.686928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.686928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.686928] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.686928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.686928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.687234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.687234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.687234] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1173.721869] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.722074] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.722581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.722581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.722581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.736891] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1173.789554] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.797342] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.797342] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.797561] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.798140] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.799016] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.799149] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.799347] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.799622] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.799825] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.800105] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1173.800349] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1173.800462] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1173.800631] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1173.800944] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1173.801059] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1173.801349] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1173.832204] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1173.832204] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1173.832204] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1173.832204] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.832204] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-56727dc7-ed37-4bc7-bf5e-24df74cd5293 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.832465] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-56727dc7-ed37-4bc7-bf5e-24df74cd5293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.832465] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-56727dc7-ed37-4bc7-bf5e-24df74cd5293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.832792] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-56727dc7-ed37-4bc7-bf5e-24df74cd5293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.833976] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56727dc7-ed37-4bc7-bf5e-24df74cd5293',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.153845] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.154009] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.154095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.154349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.154444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.154644] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.154744] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.154808] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.154965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.155057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.155147] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd is going to be updated. [ 1174.170847] env[69491]: INFO networking_nsxv3.common.synchronization [None req-fd2f6c9f-fe97-4a7e-bd42-519dc379943f None None] Enqueued Resource ID: 6c354fa1-3faa-4351-bb68-86d7b9cd51f5 with Priority: HIGHEST for action port [ 1174.171555] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c354fa1-3faa-4351-bb68-86d7b9cd51f5 with Priority: HIGHEST for action port [ 1174.171991] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c354fa1-3faa-4351-bb68-86d7b9cd51f5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.171991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c354fa1-3faa-4351-bb68-86d7b9cd51f5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.172137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c354fa1-3faa-4351-bb68-86d7b9cd51f5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.172371] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c354fa1-3faa-4351-bb68-86d7b9cd51f5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.172452] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c354fa1-3faa-4351-bb68-86d7b9cd51f5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.194895] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.194895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.194895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.194895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.194895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.204570] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd in Status: IN_PROGRESS for 2s [ 1174.293367] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.335936] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.336188] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.336188] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.336477] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.336656] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.336823] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 56727dc7-ed37-4bc7-bf5e-24df74cd5293 not found, creating... [ 1174.337117] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.337405] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.337405] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.337685] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.337780] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.338106] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.338305] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.338437] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.338658] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.338815] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.338968] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 56727dc7-ed37-4bc7-bf5e-24df74cd5293 is going to be created. [ 1174.360066] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.360281] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.360695] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.360800] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.361253] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.361347] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-56727dc7-ed37-4bc7-bf5e-24df74cd5293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.675031] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c354fa1-3faa-4351-bb68-86d7b9cd51f5 [ 1174.675031] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.675031] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.675255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.675346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.675449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.675539] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c354fa1-3faa-4351-bb68-86d7b9cd51f5 already deleted. [ 1174.675622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c354fa1-3faa-4351-bb68-86d7b9cd51f5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.800442] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.800442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.800442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.800442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.800442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.800442] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1174.832187] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.832422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.832499] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.832704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.832958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.843509] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1175.073253] env[69491]: INFO networking_nsxv3.common.synchronization [req-7feb70c6-931e-4172-bd46-0bc1d0e20bb1 req-252ddc98-bfcb-4b6a-8e55-1c17ae82f5f6 service nova] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_rules [ 1175.073427] env[69491]: INFO networking_nsxv3.common.synchronization [req-7feb70c6-931e-4172-bd46-0bc1d0e20bb1 req-252ddc98-bfcb-4b6a-8e55-1c17ae82f5f6 service nova] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1175.073574] env[69491]: INFO networking_nsxv3.common.synchronization [req-7feb70c6-931e-4172-bd46-0bc1d0e20bb1 req-252ddc98-bfcb-4b6a-8e55-1c17ae82f5f6 service nova] Enqueued Resource ID: 56727dc7-ed37-4bc7-bf5e-24df74cd5293 with Priority: HIGHEST for action port [ 1175.073810] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_rules [ 1175.073936] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1175.074045] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56727dc7-ed37-4bc7-bf5e-24df74cd5293 with Priority: HIGHEST for action port [ 1175.074609] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.074733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.074819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.075007] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.075131] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.076083] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.076153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.077033] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-56727dc7-ed37-4bc7-bf5e-24df74cd5293 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.077033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56727dc7-ed37-4bc7-bf5e-24df74cd5293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.077033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56727dc7-ed37-4bc7-bf5e-24df74cd5293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.077231] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56727dc7-ed37-4bc7-bf5e-24df74cd5293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.077231] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56727dc7-ed37-4bc7-bf5e-24df74cd5293',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.578605] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.578933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.581290] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56727dc7-ed37-4bc7-bf5e-24df74cd5293 with status ACTIVE [ 1175.581553] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.581685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.581829] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.581990] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.582098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.582477] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.582477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.582477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.582664] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.582751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.584032] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.584032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.584032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.584032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.584032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.584032] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56727dc7-ed37-4bc7-bf5e-24df74cd5293 is going to be updated. [ 1175.620980] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.620980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.620980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.621309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.621309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.621377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56727dc7-ed37-4bc7-bf5e-24df74cd5293" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.750866] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1175.751090] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d deletion is rescheduled due to dependency. [ 1175.751171] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.751330] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.751550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.751734] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.751850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.751914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.752089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.752176] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.752267] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.197239] env[69491]: INFO networking_nsxv3.common.synchronization [req-8d5a3439-3417-4c09-8025-4708ffabb9ba req-ea51a2b9-175e-4e9d-a57e-48aade4c9ae4 tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGHEST for action security_group_members [ 1176.197780] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGHEST for action security_group_members [ 1176.198109] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c6f902-1ed1-48d9-b962-db2feb55482d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.198259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.198329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.198531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.198688] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.198787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.198852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.198990] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.199382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.199468] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7c6f902-1ed1-48d9-b962-db2feb55482d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.213920] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd in Status: SUCCESS [ 1176.214107] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd deletion is rescheduled due to dependency. [ 1176.214223] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.255679] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.569503] env[69491]: INFO networking_nsxv3.common.synchronization [None req-4456de84-6af1-448c-b833-63f72a8bdca3 tempest-AttachInterfacesTestJSON-872077760 tempest-AttachInterfacesTestJSON-872077760-project-member] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 1176.570050] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGHEST for action security_group_members [ 1176.570364] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.570982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.570982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.570982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.570982] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.571205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.571294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.571406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.571492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.571587] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.701320] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.701689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.701689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.701844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.701889] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.702088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.702190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.702255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.702442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.702489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.702562] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7c6f902-1ed1-48d9-b962-db2feb55482d is going to be updated. [ 1176.729494] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.729628] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.729696] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.729916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.730107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.739866] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7c6f902-1ed1-48d9-b962-db2feb55482d in Status: IN_PROGRESS for 2s [ 1176.758387] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.853078] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1176.853306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.074652] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.074838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.074914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.075225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.075345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.075697] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.075774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.075841] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.076016] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.076099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.076221] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be updated. [ 1177.102865] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.103071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.103071] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.103303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.103443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.111984] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: IN_PROGRESS for 2s [ 1177.260904] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.261090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.261171] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.261429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.261526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.261629] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1177.290977] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.291381] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.291381] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.291702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.291942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.302337] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1178.752455] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7c6f902-1ed1-48d9-b962-db2feb55482d in Status: SUCCESS [ 1178.752455] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7c6f902-1ed1-48d9-b962-db2feb55482d deletion is rescheduled due to dependency. [ 1178.752944] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.014700] env[69491]: INFO networking_nsxv3.common.synchronization [req-20fb2017-e293-4784-a5fb-0a0a26184c1b req-95dd6498-0da9-426a-a032-56b13239491f tempest-ImagesOneServerNegativeTestJSON-656208746 tempest-ImagesOneServerNegativeTestJSON-656208746-project-member] Enqueued Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1179.015365] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1179.015772] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.015892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.015969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.018065] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.018313] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.018482] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.018565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.018902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.018902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.018902] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.122322] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9632268c-db1a-4548-9652-b638bc84b886 in Status: SUCCESS [ 1179.122520] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9632268c-db1a-4548-9652-b638bc84b886 deletion is rescheduled due to dependency. [ 1179.122644] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.312399] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1179.312650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.312823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.313113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.313357] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.313500] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.313569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.313782] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.313875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.313969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.314076] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.377727] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.377950] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.378129] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.378470] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.378751] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.378919] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.379061] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.379296] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.379455] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.379681] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.379803] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.379920] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.380045] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.380173] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.380272] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.380422] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.401149] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.401344] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1179.401493] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.401685] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.402018] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-c90da106-de9b-4750-b52d-b77d582cc607 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.402217] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-c90da106-de9b-4750-b52d-b77d582cc607" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.402350] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-c90da106-de9b-4750-b52d-b77d582cc607" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.403033] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-c90da106-de9b-4750-b52d-b77d582cc607" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.403033] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c90da106-de9b-4750-b52d-b77d582cc607',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.521361] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.521504] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.521633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.521897] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.522053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.522315] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.522945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.522945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.522945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.523174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.523362] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e is going to be updated. [ 1179.548436] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.548580] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.548648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.548867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.549047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.558287] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: IN_PROGRESS for 2s [ 1179.816356] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.816597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.816597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.816821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.817052] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.817052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.817335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.817335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.817335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.817494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.817620] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.817717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.817778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.817916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.818226] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.818333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.818387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.818527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.818607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.818723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.818781] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.905710] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.905951] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.906139] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.906435] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.906589] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.906750] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port c90da106-de9b-4750-b52d-b77d582cc607 not found, creating... [ 1179.907051] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.907215] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.907337] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.907571] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.907737] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.908056] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.908251] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.908376] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.908647] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.908793] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.908942] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: c90da106-de9b-4750-b52d-b77d582cc607 is going to be created. [ 1179.931862] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.931862] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.932064] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.932663] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.932663] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.932776] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-c90da106-de9b-4750-b52d-b77d582cc607" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.322168] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d: rpc.has_security_group_logging(os_id): False [ 1180.341621] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.341784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.341902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.342096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.343488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.343488] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.343488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.343488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.343488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.343488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.343488] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.343488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.343488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.343488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.343488] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.344097] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.344097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.344097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.344097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.344097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.344097] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1180.409576] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.411573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.411696] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.411896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.412307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.432790] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1181.066477] env[69491]: INFO networking_nsxv3.common.synchronization [req-20fb2017-e293-4784-a5fb-0a0a26184c1b req-a869695c-b722-4a56-96c1-a92e4726d052 service nova] Enqueued Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_rules [ 1181.066477] env[69491]: INFO networking_nsxv3.common.synchronization [req-20fb2017-e293-4784-a5fb-0a0a26184c1b req-a869695c-b722-4a56-96c1-a92e4726d052 service nova] Enqueued Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1181.066477] env[69491]: INFO networking_nsxv3.common.synchronization [req-20fb2017-e293-4784-a5fb-0a0a26184c1b req-a869695c-b722-4a56-96c1-a92e4726d052 service nova] Enqueued Resource ID: c90da106-de9b-4750-b52d-b77d582cc607 with Priority: HIGHEST for action port [ 1181.066477] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_rules [ 1181.066477] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1181.066477] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c90da106-de9b-4750-b52d-b77d582cc607 with Priority: HIGHEST for action port [ 1181.066477] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.066477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.066477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.066477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.066477] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.070151] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.073059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.073059] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-c90da106-de9b-4750-b52d-b77d582cc607 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.073059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c90da106-de9b-4750-b52d-b77d582cc607" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.073059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c90da106-de9b-4750-b52d-b77d582cc607" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.073059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c90da106-de9b-4750-b52d-b77d582cc607" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.073059] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c90da106-de9b-4750-b52d-b77d582cc607',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.570633] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: SUCCESS [ 1181.571992] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e deletion is rescheduled due to dependency. [ 1181.572251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.573655] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.573655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.574359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.574359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.574754] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.574987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.575151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.575978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.575978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.575978] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.575978] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.579035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.579035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.579035] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.579035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.579035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.579035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.579035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.579035] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.579035] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c90da106-de9b-4750-b52d-b77d582cc607 with status ACTIVE [ 1181.581064] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.581064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.581064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.581064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.581064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.581064] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.581064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.581064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.581064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.583819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.585397] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.585520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.585578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.585753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.585836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.585929] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c90da106-de9b-4750-b52d-b77d582cc607 is going to be updated. [ 1181.613197] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.613197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.613197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.613197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.613197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.613197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c90da106-de9b-4750-b52d-b77d582cc607" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.798979] env[69491]: INFO networking_nsxv3.common.synchronization [None req-99062df5-232e-4d4c-84cf-32b7c63a8566 None None] Enqueued Resource ID: 8dc1cf8a-83b2-4dd8-af3f-b0e70d04c5e5 with Priority: HIGHEST for action port [ 1181.799321] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dc1cf8a-83b2-4dd8-af3f-b0e70d04c5e5 with Priority: HIGHEST for action port [ 1181.799913] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dc1cf8a-83b2-4dd8-af3f-b0e70d04c5e5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.800220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dc1cf8a-83b2-4dd8-af3f-b0e70d04c5e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.800220] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dc1cf8a-83b2-4dd8-af3f-b0e70d04c5e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.801885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dc1cf8a-83b2-4dd8-af3f-b0e70d04c5e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.801990] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dc1cf8a-83b2-4dd8-af3f-b0e70d04c5e5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.080597] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.080597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.087911] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.306510] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8dc1cf8a-83b2-4dd8-af3f-b0e70d04c5e5 [ 1182.306958] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.307287] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.307375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.307670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.307831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.308115] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8dc1cf8a-83b2-4dd8-af3f-b0e70d04c5e5 already deleted. [ 1182.308260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dc1cf8a-83b2-4dd8-af3f-b0e70d04c5e5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.386531] env[69491]: INFO networking_nsxv3.common.synchronization [None req-dffdd2d3-f7d0-475e-ad79-472ef83e3ad7 tempest-ServerActionsTestJSON-1508696760 tempest-ServerActionsTestJSON-1508696760-project-member] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_rules [ 1182.387116] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_rules [ 1182.387832] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.387832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.387832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.388061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.388061] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.450809] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1182.451047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.467522] env[69491]: INFO networking_nsxv3.common.synchronization [None req-a2a31f47-e70e-41d0-8f3a-1812b55a1afc tempest-ServerActionsTestJSON-1508696760 tempest-ServerActionsTestJSON-1508696760-project-member] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_rules [ 1182.468544] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_rules [ 1182.468899] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.469020] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.589927] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.917372] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.917631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.917732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.917907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.918012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.918121] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 already deleted. [ 1182.918260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.918431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.918600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.918716] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.095043] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.095043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.095043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.095043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.095043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.095043] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e is going to be updated. [ 1183.142397] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.142643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.142754] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.142973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.143145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.152858] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: IN_PROGRESS for 2s [ 1183.447626] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.447824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.449217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.449217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.449217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.449217] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 already deleted. [ 1183.449217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.109842] env[69491]: INFO networking_nsxv3.common.synchronization [None req-7f213530-96cf-45fc-b767-53548ccee200 None None] Enqueued Resource ID: 5841473c-006f-47f4-9d56-5cf1dc8765a4 with Priority: HIGHEST for action port [ 1184.110232] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841473c-006f-47f4-9d56-5cf1dc8765a4 with Priority: HIGHEST for action port [ 1184.110709] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-5841473c-006f-47f4-9d56-5cf1dc8765a4 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.110855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5841473c-006f-47f4-9d56-5cf1dc8765a4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.110935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5841473c-006f-47f4-9d56-5cf1dc8765a4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.111380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5841473c-006f-47f4-9d56-5cf1dc8765a4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.111380] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5841473c-006f-47f4-9d56-5cf1dc8765a4',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.614367] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5841473c-006f-47f4-9d56-5cf1dc8765a4 [ 1184.614641] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.614858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.614954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.615228] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.615351] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.615479] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5841473c-006f-47f4-9d56-5cf1dc8765a4 already deleted. [ 1184.615586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5841473c-006f-47f4-9d56-5cf1dc8765a4" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.163048] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: SUCCESS [ 1185.163382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.163382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.163575] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.163771] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.163892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.163960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.164178] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.164251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.164341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.164502] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.164599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.164660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.164807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.164943] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.165047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.165108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.165251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.165323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.165402] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.165489] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.669580] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cc2812f-6296-4ced-a800-c6fb38741a8e: rpc.has_security_group_logging(os_id): False [ 1185.703557] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.703557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.703557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.703557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.703557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.703557] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.703557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.703557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.703557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.703557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.712598] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.712598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.712598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.712598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.712598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.712598] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.712598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.712598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.712598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.712598] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.712598] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e is going to be updated. [ 1185.788953] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.788953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.790208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.790208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.790208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.803718] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: IN_PROGRESS for 2s [ 1187.819686] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: SUCCESS [ 1187.820090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.845266] env[69491]: INFO networking_nsxv3.common.synchronization [req-8d2f2611-3483-46b8-9d8c-6d0f646db5c5 req-251cef85-bd23-4c4e-a49f-678ef9839481 tempest-AttachVolumeShelveTestJSON-1615643752 tempest-AttachVolumeShelveTestJSON-1615643752-project-member] Enqueued Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_members [ 1187.845508] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_members [ 1187.845863] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.846060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.846243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.846554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.846771] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.846950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.847051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.847246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.847361] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.847480] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.148425] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.148669] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.148767] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.149150] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.149442] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.149614] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.149741] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.149982] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.150159] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.150396] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.150513] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.150700] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.150907] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.151073] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.151212] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.151837] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.171955] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.172328] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1188.172570] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.172904] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.173324] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.173515] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.173649] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.173998] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.174165] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcf06d4a-f85a-4a4d-8a64-7070b4da45f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.351711] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.351898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.351986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.352266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.352373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.352606] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.352742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.352803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.352991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.353089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.353207] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da83f74d-33e1-4838-a0f1-70f509a0a68c already deleted. [ 1188.353317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.679525] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.679525] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.679525] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.679525] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.679525] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.679525] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 not found, creating... [ 1188.680125] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.680125] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.680761] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.681051] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.681285] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.682151] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.682151] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.682151] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.682409] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.682776] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.682776] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 is going to be created. [ 1188.709950] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.710434] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.710648] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.710992] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.711340] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.711614] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.422200] env[69491]: INFO networking_nsxv3.common.synchronization [req-8d2f2611-3483-46b8-9d8c-6d0f646db5c5 req-313c67f7-349a-4cb2-bc74-e45dec165289 service nova] Enqueued Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_rules [ 1189.422200] env[69491]: INFO networking_nsxv3.common.synchronization [req-8d2f2611-3483-46b8-9d8c-6d0f646db5c5 req-313c67f7-349a-4cb2-bc74-e45dec165289 service nova] Enqueued Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_members [ 1189.422200] env[69491]: INFO networking_nsxv3.common.synchronization [req-8d2f2611-3483-46b8-9d8c-6d0f646db5c5 req-313c67f7-349a-4cb2-bc74-e45dec165289 service nova] Enqueued Resource ID: bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 with Priority: HIGHEST for action port [ 1189.422200] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_rules [ 1189.422200] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_members [ 1189.422200] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 with Priority: HIGHEST for action port [ 1189.422861] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.423115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.423364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.425216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.425216] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.425216] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.425216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.425216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.425216] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.425216] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.425663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.425663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.425663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.425663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.425663] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.426861] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.426861] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.426861] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.427023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.427066] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcf06d4a-f85a-4a4d-8a64-7070b4da45f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.928836] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.930319] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.930462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.930692] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 with status ACTIVE [ 1189.930846] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.930948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.931017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.931631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.931631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.931631] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.931631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.931845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.931845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.931917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.932096] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.932193] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.932254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.932653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.932653] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.932653] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 is going to be updated. [ 1189.956458] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.956700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.956700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.956886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.957042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.957245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.437472] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.940788] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.940969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.941062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.941294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.941386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.941529] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da83f74d-33e1-4838-a0f1-70f509a0a68c is going to be created. [ 1190.970576] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.970576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.970691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.970837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.970999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.982039] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da83f74d-33e1-4838-a0f1-70f509a0a68c in Status: UNINITIALIZED for 2s [ 1191.205949] env[69491]: INFO networking_nsxv3.common.synchronization [None req-476a8dec-1092-4854-8d6c-4b9d7a059e5d tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGHEST for action security_group_rules [ 1191.206847] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGHEST for action security_group_rules [ 1191.207243] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57114c60-305d-46b5-a583-fad2bd258d54 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.207752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.207864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.208229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.208520] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57114c60-305d-46b5-a583-fad2bd258d54',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.298698] env[69491]: INFO networking_nsxv3.common.synchronization [None req-4344fb47-b43e-4116-9394-f747dc743561 tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGHEST for action security_group_rules [ 1191.299320] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGHEST for action security_group_rules [ 1191.299711] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57114c60-305d-46b5-a583-fad2bd258d54 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.299862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.735029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.735029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.735029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.735029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.735486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.735486] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57114c60-305d-46b5-a583-fad2bd258d54 already deleted. [ 1191.735486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.735486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.736298] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.736298] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57114c60-305d-46b5-a583-fad2bd258d54',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.265496] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.265702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.265783] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.266134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.266260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.266400] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57114c60-305d-46b5-a583-fad2bd258d54 already deleted. [ 1192.266491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.996441] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da83f74d-33e1-4838-a0f1-70f509a0a68c in Status: SUCCESS [ 1192.996852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.997051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.997289] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.997508] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.997632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.997688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.997851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.997930] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.998077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.998193] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.501367] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.004616] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da83f74d-33e1-4838-a0f1-70f509a0a68c: rpc.has_security_group_logging(os_id): False [ 1194.024607] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.024907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.024907] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.025199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.025199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.026103] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.026103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.026103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.026103] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.026583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.026583] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da83f74d-33e1-4838-a0f1-70f509a0a68c is going to be created. [ 1194.086778] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.086947] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.086947] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.087129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.087336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.103791] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da83f74d-33e1-4838-a0f1-70f509a0a68c in Status: IN_PROGRESS for 2s [ 1194.781346] env[69491]: INFO networking_nsxv3.common.synchronization [req-45625f14-7ce4-464f-a1c4-15ba35986180 req-283d9200-891a-48c3-8027-459f7913e70c tempest-ServerActionsTestJSON-1508696760 tempest-ServerActionsTestJSON-1508696760-project-member] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1194.782137] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1194.782553] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.782729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.782821] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.783568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.783568] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.783568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.783922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.783922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.784034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.784136] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.108958] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-698 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.109455] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.109455] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.109895] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.110273] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.110645] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.110749] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.111081] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.111317] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.111680] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1195.112864] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1195.112864] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1195.112864] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1195.112864] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1195.112864] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1195.112864] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1195.134120] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1195.134433] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1195.134672] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1195.135016] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.135497] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-1f25f29f-fd83-439a-a7c8-c336c58ff2b8 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.135798] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-1f25f29f-fd83-439a-a7c8-c336c58ff2b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.135991] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-1f25f29f-fd83-439a-a7c8-c336c58ff2b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.136488] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-1f25f29f-fd83-439a-a7c8-c336c58ff2b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.136731] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f25f29f-fd83-439a-a7c8-c336c58ff2b8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.287980] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.288317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.288466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.288877] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.289075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.289488] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.289640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.289758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.290096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.290368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.290494] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 already deleted. [ 1195.290594] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.643631] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.643884] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.643964] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.644494] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.644750] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.644926] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 1f25f29f-fd83-439a-a7c8-c336c58ff2b8 not found, creating... [ 1195.645280] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.645486] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.645597] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.645866] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.646043] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.646370] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.646552] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.646668] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.646919] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.647078] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.647318] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 1f25f29f-fd83-439a-a7c8-c336c58ff2b8 is going to be created. [ 1195.710429] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.710725] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.710944] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.711421] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.711802] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.712249] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-1f25f29f-fd83-439a-a7c8-c336c58ff2b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.119837] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da83f74d-33e1-4838-a0f1-70f509a0a68c in Status: SUCCESS [ 1196.120296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.404126] env[69491]: INFO networking_nsxv3.common.synchronization [req-45625f14-7ce4-464f-a1c4-15ba35986180 req-16f388ba-d6e5-4e29-8bf6-765bac176031 service nova] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_rules [ 1196.404319] env[69491]: INFO networking_nsxv3.common.synchronization [req-45625f14-7ce4-464f-a1c4-15ba35986180 req-16f388ba-d6e5-4e29-8bf6-765bac176031 service nova] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1196.404455] env[69491]: INFO networking_nsxv3.common.synchronization [req-45625f14-7ce4-464f-a1c4-15ba35986180 req-16f388ba-d6e5-4e29-8bf6-765bac176031 service nova] Enqueued Resource ID: 1f25f29f-fd83-439a-a7c8-c336c58ff2b8 with Priority: HIGHEST for action port [ 1196.405309] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_rules [ 1196.405309] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1196.405563] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f25f29f-fd83-439a-a7c8-c336c58ff2b8 with Priority: HIGHEST for action port [ 1196.405780] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.405911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.406079] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.406268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.406361] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.407322] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.407481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.407596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.407804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.408046] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.408172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.408245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.409095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.409095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.409095] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.410035] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f25f29f-fd83-439a-a7c8-c336c58ff2b8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.410035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f25f29f-fd83-439a-a7c8-c336c58ff2b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.410035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f25f29f-fd83-439a-a7c8-c336c58ff2b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.410035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f25f29f-fd83-439a-a7c8-c336c58ff2b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.410035] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f25f29f-fd83-439a-a7c8-c336c58ff2b8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.912512] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.913577] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.913737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.913872] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f25f29f-fd83-439a-a7c8-c336c58ff2b8 with status ACTIVE [ 1196.913998] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.914147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.914450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.914720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.915027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.915027] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.915145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.915180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.915360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.915443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.915635] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.915738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.916635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.916635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.916635] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.916635] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f25f29f-fd83-439a-a7c8-c336c58ff2b8 is going to be updated. [ 1196.939468] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.939468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.939468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.939762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.939857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.940483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f25f29f-fd83-439a-a7c8-c336c58ff2b8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.118852] env[69491]: INFO networking_nsxv3.common.synchronization [req-5c1519e4-07ce-4ae2-97f9-8aac081e9f98 req-85e87310-851e-4f58-8060-c8d56fde710d tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1197.120138] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1197.120527] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.120527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.120625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.120804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.120983] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.121203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.121271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.121439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.121526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.121623] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.418657] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.465778] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.466021] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.466181] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.467930] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.467930] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.467930] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.467930] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.467930] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.467930] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.467930] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1197.468311] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1197.468403] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1197.468574] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1197.468887] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1197.469107] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1197.469362] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1197.489348] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1197.489348] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1197.489531] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1197.489610] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.489922] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-e4692ee3-89f3-4271-8871-26244e358d3b taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.490261] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-e4692ee3-89f3-4271-8871-26244e358d3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.490422] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-e4692ee3-89f3-4271-8871-26244e358d3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.490816] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-e4692ee3-89f3-4271-8871-26244e358d3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.490958] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4692ee3-89f3-4271-8871-26244e358d3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.624490] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.920906] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.920906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.920906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.921272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.921272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.921272] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be created. [ 1197.961849] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.962161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.962161] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.962574] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.962878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.979182] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: UNINITIALIZED for 2s [ 1197.993705] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.994014] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.994220] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.994581] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.994781] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.995012] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port e4692ee3-89f3-4271-8871-26244e358d3b not found, creating... [ 1197.995357] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.995611] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.995768] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.996163] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.996388] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.996939] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.996939] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.997150] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.997470] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.997763] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.997843] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: e4692ee3-89f3-4271-8871-26244e358d3b is going to be created. [ 1198.023221] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.023221] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.023221] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.023221] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.023695] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.023695] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-e4692ee3-89f3-4271-8871-26244e358d3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.128490] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.632135] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.632619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.632619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.632733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.632767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.632978] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1198.670157] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.671340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.671340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.671340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.671340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.682802] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1198.754450] env[69491]: INFO networking_nsxv3.common.synchronization [req-5c1519e4-07ce-4ae2-97f9-8aac081e9f98 req-5711e215-1367-425d-b08e-31df18dc05bb service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 1198.754885] env[69491]: INFO networking_nsxv3.common.synchronization [req-5c1519e4-07ce-4ae2-97f9-8aac081e9f98 req-5711e215-1367-425d-b08e-31df18dc05bb service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1198.755100] env[69491]: INFO networking_nsxv3.common.synchronization [req-5c1519e4-07ce-4ae2-97f9-8aac081e9f98 req-5711e215-1367-425d-b08e-31df18dc05bb service nova] Enqueued Resource ID: e4692ee3-89f3-4271-8871-26244e358d3b with Priority: HIGHEST for action port [ 1198.755452] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 1198.755977] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1198.755977] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4692ee3-89f3-4271-8871-26244e358d3b with Priority: HIGHEST for action port [ 1198.758178] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.758178] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.758178] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.758178] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.758178] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.758897] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.759034] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.759274] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4692ee3-89f3-4271-8871-26244e358d3b taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.759414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4692ee3-89f3-4271-8871-26244e358d3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.759494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4692ee3-89f3-4271-8871-26244e358d3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.759674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4692ee3-89f3-4271-8871-26244e358d3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.759759] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4692ee3-89f3-4271-8871-26244e358d3b',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.271679] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4692ee3-89f3-4271-8871-26244e358d3b with status ACTIVE [ 1199.271679] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.271679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.271679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.271679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.271679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.271679] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.271679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.271679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.271679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.271679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.271679] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.271679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.271679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.271679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.271679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.271679] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4692ee3-89f3-4271-8871-26244e358d3b is going to be updated. [ 1199.273637] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.273880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.297488] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.297698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.297776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.298266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.298805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.298805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4692ee3-89f3-4271-8871-26244e358d3b" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.992260] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1199.992260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.992260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.992260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.992260] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.992260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.992260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.992689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.992689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.992689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.992689] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.496039] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.698779] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1200.699043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.699369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.699651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.699856] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.700035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.700163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.700399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.700498] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.700663] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.001622] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf9b465c-1203-4ee7-a3bb-19ccfc886da5: rpc.has_security_group_logging(os_id): False [ 1201.022112] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.022343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.022449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.022755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.022890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.023372] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.023372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.023473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.023648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.023742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.023837] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be created. [ 1201.099061] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.099061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.099061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.099061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.099061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.116663] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: IN_PROGRESS for 2s [ 1201.203338] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.706172] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.212343] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.212497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.212565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.212794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.212886] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.212989] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1202.264113] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.264365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.264365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.264547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.264674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.276986] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1202.789400] env[69491]: INFO networking_nsxv3.common.synchronization [req-e25fe1d5-22db-4ea1-9ad5-d6f7d4d8e486 req-2c980a82-1d4e-4790-9856-c67dd9cde3e3 tempest-ImagesOneServerNegativeTestJSON-656208746 tempest-ImagesOneServerNegativeTestJSON-656208746-project-member] Enqueued Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1202.789996] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1202.790329] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.790456] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.790525] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.790731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.790892] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.791707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.791707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.791707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.791707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.791707] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.130788] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1203.130788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.294585] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.294804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.294853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.295104] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.295200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.295560] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.295560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.295560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.295773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.295809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.295897] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e is going to be updated. [ 1203.325019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.325371] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.325371] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.325466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.325608] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.335221] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: IN_PROGRESS for 2s [ 1203.483376] env[69491]: INFO networking_nsxv3.common.synchronization [req-45a2423a-374a-477a-aa5a-cb0a021e304e req-0ee0c3e7-c313-45f6-b64f-0b41abf652c5 tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGHEST for action security_group_members [ 1203.483946] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGHEST for action security_group_members [ 1203.484276] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57114c60-305d-46b5-a583-fad2bd258d54 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.484403] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.484470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.484804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.484906] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.485017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.485085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.485246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.485333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.485427] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57114c60-305d-46b5-a583-fad2bd258d54',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.857323] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-348 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.857323] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.857323] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.857323] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.857722] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.857722] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.857806] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.858122] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.858757] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.858757] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1203.858757] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1203.858757] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1203.858970] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1203.858970] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1203.859069] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1203.859188] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1203.882617] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1203.882817] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1203.882976] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1203.883597] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-348" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.883597] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-7bf85156-bb62-431a-ae9c-d7ed59475557 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.883726] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-7bf85156-bb62-431a-ae9c-d7ed59475557" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.883762] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-7bf85156-bb62-431a-ae9c-d7ed59475557" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.884117] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-7bf85156-bb62-431a-ae9c-d7ed59475557" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.884269] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bf85156-bb62-431a-ae9c-d7ed59475557',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.987418] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.987701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.987701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.987871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.988047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.988378] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.988526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.988526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.988663] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.988730] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.988815] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57114c60-305d-46b5-a583-fad2bd258d54 already deleted. [ 1203.988900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.287081] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1204.287300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.287572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.287860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.288147] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.288310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.288381] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.288581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.288693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.288812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.288987] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.386557] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.386830] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.386969] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.387334] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.387509] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.387677] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 7bf85156-bb62-431a-ae9c-d7ed59475557 not found, creating... [ 1204.388027] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.388239] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.388368] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.388610] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.388757] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.389091] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.389270] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.389395] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.389621] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.389765] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.389914] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 7bf85156-bb62-431a-ae9c-d7ed59475557 is going to be created. [ 1204.410607] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.410607] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.410607] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.410892] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.411134] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.411356] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-7bf85156-bb62-431a-ae9c-d7ed59475557" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.791893] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.792162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.792247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.792472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.792651] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.792774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.792840] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.793052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.793170] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.793244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.793398] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.793494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.793552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.793694] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.793832] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.793923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.793984] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.794140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.794219] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.794300] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.794393] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.157362] env[69491]: INFO networking_nsxv3.common.synchronization [req-45a2423a-374a-477a-aa5a-cb0a021e304e req-02739e16-096b-477a-8ece-a82d5f616cdc service nova] Enqueued Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGHEST for action security_group_rules [ 1205.157926] env[69491]: INFO networking_nsxv3.common.synchronization [req-45a2423a-374a-477a-aa5a-cb0a021e304e req-02739e16-096b-477a-8ece-a82d5f616cdc service nova] Enqueued Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGHEST for action security_group_members [ 1205.157926] env[69491]: INFO networking_nsxv3.common.synchronization [req-45a2423a-374a-477a-aa5a-cb0a021e304e req-02739e16-096b-477a-8ece-a82d5f616cdc service nova] Enqueued Resource ID: 7bf85156-bb62-431a-ae9c-d7ed59475557 with Priority: HIGHEST for action port [ 1205.158596] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGHEST for action security_group_rules [ 1205.158748] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGHEST for action security_group_members [ 1205.158850] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf85156-bb62-431a-ae9c-d7ed59475557 with Priority: HIGHEST for action port [ 1205.159199] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57114c60-305d-46b5-a583-fad2bd258d54 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.159368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.159486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.159780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.159918] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57114c60-305d-46b5-a583-fad2bd258d54',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.161208] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57114c60-305d-46b5-a583-fad2bd258d54 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.161341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.161519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.161732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.161972] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.162075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.162146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.162328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.162376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.162464] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57114c60-305d-46b5-a583-fad2bd258d54',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.163406] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bf85156-bb62-431a-ae9c-d7ed59475557 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.163406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bf85156-bb62-431a-ae9c-d7ed59475557" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.163530] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bf85156-bb62-431a-ae9c-d7ed59475557" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.163568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bf85156-bb62-431a-ae9c-d7ed59475557" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.163647] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bf85156-bb62-431a-ae9c-d7ed59475557',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.296678] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d394eeb6-7de4-4a71-8d79-c137cc55ad50: rpc.has_security_group_logging(os_id): False [ 1205.316695] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.316888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.316888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.317136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.317233] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.317459] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.317559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.317625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.317781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.317858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.318111] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.318212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.318275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.318435] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.318510] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.318710] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.318805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.318866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.319074] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.319157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.319246] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1205.343563] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: SUCCESS [ 1205.343770] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e deletion is rescheduled due to dependency. [ 1205.343861] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.383206] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.383559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.383559] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.383758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.383952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.398999] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1205.665579] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57114c60-305d-46b5-a583-fad2bd258d54',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.667409] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57114c60-305d-46b5-a583-fad2bd258d54 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.667491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.667609] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bf85156-bb62-431a-ae9c-d7ed59475557 with status ACTIVE [ 1205.667767] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.667873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.667963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.668231] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.668325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.668503] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.668599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.668661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.669151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.669151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.669151] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.669151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.669354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.669354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.669416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.669509] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bf85156-bb62-431a-ae9c-d7ed59475557 is going to be updated. [ 1205.695076] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.695231] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.695296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.695520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.695658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.695815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bf85156-bb62-431a-ae9c-d7ed59475557" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.171399] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57114c60-305d-46b5-a583-fad2bd258d54',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.675765] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.676566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.676566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.676566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.676566] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.677051] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57114c60-305d-46b5-a583-fad2bd258d54 is going to be created. [ 1206.704051] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.704051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.704051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.704051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.704286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.715605] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57114c60-305d-46b5-a583-fad2bd258d54 in Status: UNINITIALIZED for 2s [ 1207.426342] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1207.426342] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.440232] env[69491]: INFO networking_nsxv3.common.synchronization [req-9a48fc27-afc8-43bf-b9c0-df7ae4488e2c req-def8a134-9770-43c9-a1a2-e0bc7f74af0a tempest-DeleteServersTestJSON-1018355336 tempest-DeleteServersTestJSON-1018355336-project-member] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1207.440802] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1207.441117] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.441246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.441338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.441530] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.441689] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.441803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.441974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.444043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.444043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.444043] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.947033] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.947229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.947308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.947601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.947702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.947999] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.948148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.948208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.948386] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.948467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.948559] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1207.983406] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.983406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.983406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.983406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.983406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.994289] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1208.725728] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57114c60-305d-46b5-a583-fad2bd258d54 in Status: SUCCESS [ 1208.726140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.726183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.726372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.726560] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.726676] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.726743] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.726890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.726970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.727068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.727155] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57114c60-305d-46b5-a583-fad2bd258d54',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.230321] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57114c60-305d-46b5-a583-fad2bd258d54',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.732276] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57114c60-305d-46b5-a583-fad2bd258d54: rpc.has_security_group_logging(os_id): False [ 1209.752429] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.752671] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.752726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.753026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.753151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.753485] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.753692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.753692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.753906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.754032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.754162] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57114c60-305d-46b5-a583-fad2bd258d54 is going to be created. [ 1209.848683] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.849026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.849163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.849491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.849680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.865396] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57114c60-305d-46b5-a583-fad2bd258d54 in Status: IN_PROGRESS for 2s [ 1210.029229] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1210.029500] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d deletion is rescheduled due to dependency. [ 1210.029674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.648359] env[69491]: INFO networking_nsxv3.common.synchronization [req-2d93c0f0-8784-4e2a-ac39-8df031a31023 req-55bbc6e1-9052-4ec5-a95c-96792f0107ea tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1210.649441] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1210.649678] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.649678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.649792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.651127] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.651127] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.651127] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.651127] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.651370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.651370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.651370] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.154114] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.658113] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.879455] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57114c60-305d-46b5-a583-fad2bd258d54 in Status: SUCCESS [ 1211.879455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.161866] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.161866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.161866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.161866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.161866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.161866] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1212.198028] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.198028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.198028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.198028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.198028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.210174] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1214.223025] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1214.223321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.393872] env[69491]: INFO networking_nsxv3.common.synchronization [req-03dab214-2ec6-418c-82ab-350c4aa3cca0 req-1d2b7b13-a993-45d4-8e05-9412bdffbed0 tempest-ImagesOneServerNegativeTestJSON-656208746 tempest-ImagesOneServerNegativeTestJSON-656208746-project-member] Enqueued Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1214.394483] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1214.394839] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.394987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.395229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.395631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.395848] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.396908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.396908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.396908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.396908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.396908] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.692248] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.692709] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.693233] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.693634] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.694168] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.694626] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.694896] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.695533] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.696230] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.696678] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.696946] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1214.697265] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1214.697529] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1214.697792] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.698032] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1214.698308] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1214.719585] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1214.719774] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1214.719924] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1214.720135] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-599" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.720499] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-3cd8ed25-ab46-44cd-ab8e-4348e4cf5580 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.720693] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-3cd8ed25-ab46-44cd-ab8e-4348e4cf5580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.720867] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-3cd8ed25-ab46-44cd-ab8e-4348e4cf5580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.721175] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-3cd8ed25-ab46-44cd-ab8e-4348e4cf5580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.721326] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd8ed25-ab46-44cd-ab8e-4348e4cf5580',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.899074] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.899294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.899294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.899495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.899590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.899804] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.899903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.899964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.900195] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.900279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.900369] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e is going to be updated. [ 1214.926752] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.926900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.926974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.927215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.927332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.936038] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: IN_PROGRESS for 2s [ 1215.225228] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.225686] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.225686] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.225839] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.226029] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.226196] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 3cd8ed25-ab46-44cd-ab8e-4348e4cf5580 not found, creating... [ 1215.226531] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.226719] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.226851] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.227108] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.227259] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.227962] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.228161] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.228287] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.228512] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.228657] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.228805] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 3cd8ed25-ab46-44cd-ab8e-4348e4cf5580 is going to be created. [ 1215.247874] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.248177] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.248314] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.248573] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.248805] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.249087] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-3cd8ed25-ab46-44cd-ab8e-4348e4cf5580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.939526] env[69491]: INFO networking_nsxv3.common.synchronization [req-03dab214-2ec6-418c-82ab-350c4aa3cca0 req-e3c6b1bc-868c-4e1c-8543-4e8b5fdf60ab service nova] Enqueued Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_rules [ 1215.939526] env[69491]: INFO networking_nsxv3.common.synchronization [req-03dab214-2ec6-418c-82ab-350c4aa3cca0 req-e3c6b1bc-868c-4e1c-8543-4e8b5fdf60ab service nova] Enqueued Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1215.939695] env[69491]: INFO networking_nsxv3.common.synchronization [req-03dab214-2ec6-418c-82ab-350c4aa3cca0 req-e3c6b1bc-868c-4e1c-8543-4e8b5fdf60ab service nova] Enqueued Resource ID: 3cd8ed25-ab46-44cd-ab8e-4348e4cf5580 with Priority: HIGHEST for action port [ 1215.940444] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_rules [ 1215.940583] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1215.940678] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd8ed25-ab46-44cd-ab8e-4348e4cf5580 with Priority: HIGHEST for action port [ 1215.940990] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.942224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.942224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.942224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.942388] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.943305] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.944015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.944274] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cd8ed25-ab46-44cd-ab8e-4348e4cf5580 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.944376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cd8ed25-ab46-44cd-ab8e-4348e4cf5580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.944455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cd8ed25-ab46-44cd-ab8e-4348e4cf5580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.944674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cd8ed25-ab46-44cd-ab8e-4348e4cf5580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.944758] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd8ed25-ab46-44cd-ab8e-4348e4cf5580',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.447271] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.447601] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.447601] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cd8ed25-ab46-44cd-ab8e-4348e4cf5580 with status ACTIVE [ 1216.447748] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.447850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.447955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.448174] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.448267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.448442] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.448531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.448590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.448740] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.448817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.448999] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.449127] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.449181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.449305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.449378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.449462] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cd8ed25-ab46-44cd-ab8e-4348e4cf5580 is going to be updated. [ 1216.471282] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.471425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.471501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.471700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.471893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.471982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cd8ed25-ab46-44cd-ab8e-4348e4cf5580" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.636430] env[69491]: INFO networking_nsxv3.common.synchronization [req-bb02f82f-8d2f-46c3-9226-72100c9cb2ea req-1a29c2ff-7513-4ede-aa42-925e603d7b87 tempest-DeleteServersTestJSON-1018355336 tempest-DeleteServersTestJSON-1018355336-project-member] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1216.636945] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1216.637362] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.637536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.637629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.637893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.638166] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.638315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.638410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.638640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.640507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.640507] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.946096] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: SUCCESS [ 1216.946382] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e deletion is rescheduled due to dependency. [ 1216.946497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.946569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.946793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.946977] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.947111] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.947179] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.947340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.947422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.947514] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.950018] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.950155] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.950202] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.950544] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.950725] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.950892] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.951026] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.951244] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.951385] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.951588] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1216.951715] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1216.951830] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1216.951944] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1216.952074] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1216.952190] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1216.952327] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1216.970973] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1216.971178] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1216.971348] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1216.971548] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.971871] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-3994cd00-08bb-4021-b92a-357a30bc28e7 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.972066] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-3994cd00-08bb-4021-b92a-357a30bc28e7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.972199] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-3994cd00-08bb-4021-b92a-357a30bc28e7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.972538] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-3994cd00-08bb-4021-b92a-357a30bc28e7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.972686] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3994cd00-08bb-4021-b92a-357a30bc28e7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.141969] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.142264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.142264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.142478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.142560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.142737] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.142868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.142972] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.143097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.143183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.143259] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1217.177637] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.178052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.178052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.178252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.178331] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.187211] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1217.454517] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.474787] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.475120] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.475298] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.475619] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.475815] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.476150] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 3994cd00-08bb-4021-b92a-357a30bc28e7 not found, creating... [ 1217.476506] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.476694] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.476826] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.477126] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.477283] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.477604] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.477777] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.477905] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.478243] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.478402] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.478540] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 3994cd00-08bb-4021-b92a-357a30bc28e7 is going to be created. [ 1217.498718] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.498939] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.499084] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.499330] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.499567] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.499794] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-3994cd00-08bb-4021-b92a-357a30bc28e7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.957707] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.214531] env[69491]: INFO networking_nsxv3.common.synchronization [req-bb02f82f-8d2f-46c3-9226-72100c9cb2ea req-9a36b7d0-1ca9-4a5c-8542-7bf4ee2e4f8b service nova] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_rules [ 1218.214706] env[69491]: INFO networking_nsxv3.common.synchronization [req-bb02f82f-8d2f-46c3-9226-72100c9cb2ea req-9a36b7d0-1ca9-4a5c-8542-7bf4ee2e4f8b service nova] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1218.214850] env[69491]: INFO networking_nsxv3.common.synchronization [req-bb02f82f-8d2f-46c3-9226-72100c9cb2ea req-9a36b7d0-1ca9-4a5c-8542-7bf4ee2e4f8b service nova] Enqueued Resource ID: 3994cd00-08bb-4021-b92a-357a30bc28e7 with Priority: HIGHEST for action port [ 1218.215521] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_rules [ 1218.215797] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1218.215797] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3994cd00-08bb-4021-b92a-357a30bc28e7 with Priority: HIGHEST for action port [ 1218.216373] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.216529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.216604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.216828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.216911] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.218208] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.218317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.218547] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-3994cd00-08bb-4021-b92a-357a30bc28e7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.218715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3994cd00-08bb-4021-b92a-357a30bc28e7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.218755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3994cd00-08bb-4021-b92a-357a30bc28e7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.219011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3994cd00-08bb-4021-b92a-357a30bc28e7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.219120] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3994cd00-08bb-4021-b92a-357a30bc28e7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.460636] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.461038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.461038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.461038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.461158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.461223] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e is going to be updated. [ 1218.493539] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.493718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.493789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.494035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.494576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.505593] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: IN_PROGRESS for 2s [ 1218.720515] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.720709] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.720931] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3994cd00-08bb-4021-b92a-357a30bc28e7 with status ACTIVE [ 1218.721129] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.721239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.721307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.721521] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.721613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.721790] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.722029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.722029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.722107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.722194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.722379] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.722472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.722564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.722675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.722748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.722836] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3994cd00-08bb-4021-b92a-357a30bc28e7 is going to be updated. [ 1218.747073] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.747315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.747315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.747427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.747712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.747712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3994cd00-08bb-4021-b92a-357a30bc28e7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.197798] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1219.198082] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d deletion is rescheduled due to dependency. [ 1219.198208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.198374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.198588] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.198771] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.198894] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.199290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.199290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.199290] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.199290] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.565728] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.566122] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.566270] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.566581] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.566893] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.567088] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.567220] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.567450] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.567606] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.568148] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.568148] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.568148] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.568306] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.568780] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.568780] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.568780] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.587267] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.587456] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1219.587584] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.587766] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-122" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.588143] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-de7c92e2-bc02-4693-a264-d2038b95cfc2 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.588329] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.588458] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.588727] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.588870] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de7c92e2-bc02-4693-a264-d2038b95cfc2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.704347] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.091282] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.091520] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.091581] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.091891] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.092075] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.092420] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.092602] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.092757] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.093037] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.093186] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.093515] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.093707] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.093820] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.094073] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.094245] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.094420] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: de7c92e2-bc02-4693-a264-d2038b95cfc2 is going to be updated. [ 1220.121162] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.121502] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.121637] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.121892] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.122158] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.122473] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.207768] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.518087] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: SUCCESS [ 1220.518368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.518552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.518781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.518981] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.519124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.519183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.519350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.519433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.519509] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.519601] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.710687] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.711224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.711224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.711362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.711430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.711528] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1220.745501] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.745751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.745751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.745963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.746152] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.755755] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1220.805086] env[69491]: INFO networking_nsxv3.common.synchronization [req-18e200e0-3fdf-4605-a472-cd6153e1f84b req-380cf978-936d-4c20-aa1d-18b3c9592980 service nova] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_rules [ 1220.805279] env[69491]: INFO networking_nsxv3.common.synchronization [req-18e200e0-3fdf-4605-a472-cd6153e1f84b req-380cf978-936d-4c20-aa1d-18b3c9592980 service nova] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 1220.805426] env[69491]: INFO networking_nsxv3.common.synchronization [req-18e200e0-3fdf-4605-a472-cd6153e1f84b req-380cf978-936d-4c20-aa1d-18b3c9592980 service nova] Enqueued Resource ID: de7c92e2-bc02-4693-a264-d2038b95cfc2 with Priority: HIGHEST for action port [ 1220.806011] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_rules [ 1220.806154] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 1220.806288] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de7c92e2-bc02-4693-a264-d2038b95cfc2 with Priority: HIGHEST for action port [ 1220.806565] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.806679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.806750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.806955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.807152] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.808062] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.808189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.808254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.808450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.808579] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.808676] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.808728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.808868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.808956] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.809062] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.809919] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-de7c92e2-bc02-4693-a264-d2038b95cfc2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.810056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.810125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.810280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.810353] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de7c92e2-bc02-4693-a264-d2038b95cfc2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.022341] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.022560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.022560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.022790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.022960] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.023082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.023146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.023296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.023384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.023472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.023620] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.023711] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.023769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.023910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.024062] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.024227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.024227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.024377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.024429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.024492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.024578] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.312729] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.313738] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.313894] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.314265] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de7c92e2-bc02-4693-a264-d2038b95cfc2 with status ACTIVE [ 1221.314433] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.314547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.314618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.314854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.314985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.315143] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.315249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.315304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.315455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.315527] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.315857] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.315857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.316060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.316060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.316135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.316254] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de7c92e2-bc02-4693-a264-d2038b95cfc2 is going to be updated. [ 1221.338315] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.338632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.338632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.338757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.338862] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.339077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de7c92e2-bc02-4693-a264-d2038b95cfc2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.526996] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cc2812f-6296-4ced-a800-c6fb38741a8e: rpc.has_security_group_logging(os_id): False [ 1221.549944] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.549944] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.549944] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.550130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.550247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.550464] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.551083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.551083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.551083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.551083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.551364] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.551364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.551364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.551495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.551495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.551695] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.551790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.551870] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.551991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.552084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.552171] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e is going to be updated. [ 1221.635237] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.635435] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.635435] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.635659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.635809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.658067] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: IN_PROGRESS for 2s [ 1221.814806] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.317731] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.318014] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.318089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.318285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.318378] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.318489] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 1222.350370] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.350578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.350578] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.350801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.350948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.362658] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 1222.766729] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1222.766990] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.767218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.767442] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.767782] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.767782] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.768026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.768026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.768105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.768203] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.768292] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.272224] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.272486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.272486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.272830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.272907] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.273052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.273127] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.273308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.273405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.273512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.273738] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.273825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.273896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.274104] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.274222] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.274315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.274376] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.274518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.274597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.274679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.274765] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.675189] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: SUCCESS [ 1223.675441] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.778459] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d: rpc.has_security_group_logging(os_id): False [ 1223.800475] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.800475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.800815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.800815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.801833] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.801833] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.801833] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.801833] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.801833] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.801833] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.801833] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.802192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.802192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.802192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.802192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.802408] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.802469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.802469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.803732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.803732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.803732] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1223.892691] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.892969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.893050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.893235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.893390] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.910151] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1224.375901] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 1224.375901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.375901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.375901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.375901] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.375901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.375901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.375901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.375901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.375901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.375901] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.877730] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.381082] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fd20800-5a4b-495c-a02a-35b10f00ea55: rpc.has_security_group_logging(os_id): False [ 1225.399732] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.399949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.399949] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.400225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.400322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.400584] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.400691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.400757] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.400923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.400992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.401096] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 1225.471379] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.471565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.471666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.471972] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.472215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.490253] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 1225.807056] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1225.807272] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1225.929171] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1225.929390] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.273436] env[69491]: INFO networking_nsxv3.common.synchronization [req-4ed40f74-b823-4624-a5cc-5b3f6e7cc20c req-dcf99126-f869-43f9-901e-e26dbb150a23 tempest-ImagesOneServerNegativeTestJSON-656208746 tempest-ImagesOneServerNegativeTestJSON-656208746-project-member] Enqueued Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1226.274032] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e with Priority: HIGHEST for action security_group_members [ 1226.275167] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cc2812f-6296-4ced-a800-c6fb38741a8e taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.275368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.275465] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.275726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.275928] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.276051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.276175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.276425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.276563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.276700] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cc2812f-6296-4ced-a800-c6fb38741a8e',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.779391] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.779785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.779785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.780022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.780163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.780437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.780565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.780652] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.780881] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.780979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.781148] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e is going to be updated. [ 1226.810338] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.810561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.810561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.810866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.811094] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.821645] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: IN_PROGRESS for 2s [ 1227.395511] env[69491]: INFO networking_nsxv3.common.synchronization [req-587e2569-710c-4b1e-b259-9a8997c5acc2 req-029e3fd1-4267-485b-9c50-f995dd99b239 tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1227.396458] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1227.396458] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.396629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.396629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.396740] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.396911] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.396961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.397044] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.397186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.397270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.397359] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.507864] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 1227.507864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.685066] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.685425] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.685566] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.685865] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.686247] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.686451] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.686583] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.686815] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.686989] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.687228] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1227.687366] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1227.687487] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1227.687605] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1227.687724] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1227.687853] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1227.688103] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1227.708949] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1227.709190] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1227.709374] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1227.709481] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-651" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.709833] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-d3909787-65ae-4340-a83f-a1c833a10480 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.710058] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-d3909787-65ae-4340-a83f-a1c833a10480" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.710187] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-d3909787-65ae-4340-a83f-a1c833a10480" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.710603] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-d3909787-65ae-4340-a83f-a1c833a10480" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.710773] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3909787-65ae-4340-a83f-a1c833a10480',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.900680] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.213155] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.213485] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.213701] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.214032] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.214216] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.214389] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port d3909787-65ae-4340-a83f-a1c833a10480 not found, creating... [ 1228.214680] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.214850] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.214976] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.215258] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.215411] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.215707] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.215934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.216087] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.216232] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.216372] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.216519] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: d3909787-65ae-4340-a83f-a1c833a10480 is going to be created. [ 1228.246463] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.246694] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.246832] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.247225] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.247595] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.247871] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-d3909787-65ae-4340-a83f-a1c833a10480" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.403536] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.833675] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e in Status: SUCCESS [ 1228.833675] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cc2812f-6296-4ced-a800-c6fb38741a8e deletion is rescheduled due to dependency. [ 1228.833974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cc2812f-6296-4ced-a800-c6fb38741a8e" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.905767] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.906212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.906212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.906212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.906328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.906377] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1228.949740] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.949953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.949953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.950217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.950321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.960152] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1228.970346] env[69491]: INFO networking_nsxv3.common.synchronization [req-587e2569-710c-4b1e-b259-9a8997c5acc2 req-39ffd3d8-d0c1-4107-8fb6-48f73f9da121 service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 1228.970648] env[69491]: INFO networking_nsxv3.common.synchronization [req-587e2569-710c-4b1e-b259-9a8997c5acc2 req-39ffd3d8-d0c1-4107-8fb6-48f73f9da121 service nova] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1228.970840] env[69491]: INFO networking_nsxv3.common.synchronization [req-587e2569-710c-4b1e-b259-9a8997c5acc2 req-39ffd3d8-d0c1-4107-8fb6-48f73f9da121 service nova] Enqueued Resource ID: d3909787-65ae-4340-a83f-a1c833a10480 with Priority: HIGHEST for action port [ 1228.971421] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_rules [ 1228.971564] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1228.971665] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3909787-65ae-4340-a83f-a1c833a10480 with Priority: HIGHEST for action port [ 1228.971966] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.972116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.972187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.972410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.972526] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.973372] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.973494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.973657] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3909787-65ae-4340-a83f-a1c833a10480 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.973767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3909787-65ae-4340-a83f-a1c833a10480" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.973832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3909787-65ae-4340-a83f-a1c833a10480" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.974070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3909787-65ae-4340-a83f-a1c833a10480" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.974164] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3909787-65ae-4340-a83f-a1c833a10480',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.475836] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.476014] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.476230] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3909787-65ae-4340-a83f-a1c833a10480 with status ACTIVE [ 1229.476421] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.476541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.476613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.476843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.476939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.477150] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.477259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.477326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.477496] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.477579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.477765] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.477878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.477996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.478176] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.478258] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.478352] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3909787-65ae-4340-a83f-a1c833a10480 is going to be updated. [ 1229.501373] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.501506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.501585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.501813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.501958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.502141] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3909787-65ae-4340-a83f-a1c833a10480" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.971322] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1230.971781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.971781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.972231] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.972598] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.972801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.972922] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.973131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.973239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.973349] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.475732] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.978394] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.480673] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.480849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.480913] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.481171] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.481270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.481389] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1232.493050] env[69491]: INFO networking_nsxv3.common.synchronization [req-a80cebcb-d06c-4b8d-a6f4-b38cff27e482 req-21890bf1-60a1-4efa-8bdd-0684d04fa1aa tempest-DeleteServersTestJSON-1018355336 tempest-DeleteServersTestJSON-1018355336-project-member] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1232.493718] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1232.494407] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.494407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.494407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.495621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.495621] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.495621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.495621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.495621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.495621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.495621] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.523928] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.524054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.524143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.524408] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.524590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.540088] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1233.000154] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.000154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.000154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.000154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.000154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.000611] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.000611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.000792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.000994] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.001332] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.001579] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1233.033181] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.033375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.033375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.033568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.033768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.043345] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1234.554431] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1234.554431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.554431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.554431] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.555160] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.556672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.556672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.556672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.556672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.556672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.556672] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.054434] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1235.054644] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d deletion is rescheduled due to dependency. [ 1235.054742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.058348] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.058497] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.058798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.058798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.059129] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.059129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.059129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.059549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.059549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.059549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.059699] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.059764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.059800] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.060052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.060131] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.060182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.060232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.060424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.060424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.060529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.060581] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.406158] env[69491]: INFO networking_nsxv3.common.synchronization [None req-9460c7e2-35e3-4296-bf2b-a71333f0b323 None None] Enqueued Resource ID: 4fd8231d-95b6-480c-8707-0946c95e421d with Priority: HIGHEST for action port [ 1235.406158] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fd8231d-95b6-480c-8707-0946c95e421d with Priority: HIGHEST for action port [ 1235.406158] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fd8231d-95b6-480c-8707-0946c95e421d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.406158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fd8231d-95b6-480c-8707-0946c95e421d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.406158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fd8231d-95b6-480c-8707-0946c95e421d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.406158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fd8231d-95b6-480c-8707-0946c95e421d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.406158] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fd8231d-95b6-480c-8707-0946c95e421d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.563018] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d394eeb6-7de4-4a71-8d79-c137cc55ad50: rpc.has_security_group_logging(os_id): False [ 1235.584367] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.584565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.584657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.584933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.585021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.585299] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.585622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.585622] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.585728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.585728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.585929] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.586039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.586100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.586245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.586672] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.586870] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.587050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.587158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.587475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.587475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.587583] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1235.675339] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.675558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.675667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.675976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.676143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.730251] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1235.909319] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4fd8231d-95b6-480c-8707-0946c95e421d [ 1235.909540] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.909678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.909759] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.910047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.911030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.911030] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4fd8231d-95b6-480c-8707-0946c95e421d already deleted. [ 1235.911030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fd8231d-95b6-480c-8707-0946c95e421d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.144934] env[69491]: INFO networking_nsxv3.common.synchronization [None req-78c58142-c967-4dcf-8c65-e42dac34cfc4 tempest-ServersTestFqdnHostnames-398938474 tempest-ServersTestFqdnHostnames-398938474-project-member] Enqueued Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGHEST for action security_group_rules [ 1236.145545] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGHEST for action security_group_rules [ 1236.146640] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64836ebf-8b10-4f23-98d0-28aef1aadca7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.146640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.146640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.146640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.146640] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64836ebf-8b10-4f23-98d0-28aef1aadca7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.225125] env[69491]: INFO networking_nsxv3.common.synchronization [None req-7d85aa0f-9fc4-4622-b2ee-1cd187600144 tempest-ServersTestFqdnHostnames-398938474 tempest-ServersTestFqdnHostnames-398938474-project-member] Enqueued Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGHEST for action security_group_rules [ 1236.225278] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGHEST for action security_group_rules [ 1236.225557] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64836ebf-8b10-4f23-98d0-28aef1aadca7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.225659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.668801] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.669259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.669259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.669259] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.669430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.669430] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 already deleted. [ 1236.669523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.669647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.669799] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.669878] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64836ebf-8b10-4f23-98d0-28aef1aadca7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.192856] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.192997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.193097] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.193350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.193444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.193535] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 already deleted. [ 1237.193643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.638802] env[69491]: INFO networking_nsxv3.common.synchronization [None req-24d44e44-6683-4854-823b-fa94fdea9fd9 None None] Enqueued Resource ID: 4dde54c3-f7c0-4b61-8e28-87c454074d6f with Priority: HIGHEST for action port [ 1237.639396] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dde54c3-f7c0-4b61-8e28-87c454074d6f with Priority: HIGHEST for action port [ 1237.639737] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dde54c3-f7c0-4b61-8e28-87c454074d6f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.639845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dde54c3-f7c0-4b61-8e28-87c454074d6f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.639912] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dde54c3-f7c0-4b61-8e28-87c454074d6f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.640212] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dde54c3-f7c0-4b61-8e28-87c454074d6f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.640297] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dde54c3-f7c0-4b61-8e28-87c454074d6f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.747857] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1237.748359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.143155] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4dde54c3-f7c0-4b61-8e28-87c454074d6f [ 1238.143409] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.143551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.143618] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.143861] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.143956] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.144158] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4dde54c3-f7c0-4b61-8e28-87c454074d6f already deleted. [ 1238.144257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dde54c3-f7c0-4b61-8e28-87c454074d6f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.490391] env[69491]: INFO networking_nsxv3.common.synchronization [req-5aa89ad5-684b-4547-8d9c-64d3a68a9222 req-d32206f6-d00c-4643-a68a-b1ec2beff017 tempest-ServerActionsTestOtherB-761111206 tempest-ServerActionsTestOtherB-761111206-project-member] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 1239.491022] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGHEST for action security_group_members [ 1239.491425] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.492035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.492035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.492035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.492035] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.492322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.492322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.492466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.492562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.492683] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.001025] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.001025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.001025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.001025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.001025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.001025] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.001025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.001025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.001025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.001025] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.001025] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be updated. [ 1240.032940] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.032940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.032940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.032940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.032940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.040767] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: IN_PROGRESS for 2s [ 1241.687227] env[69491]: INFO networking_nsxv3.common.synchronization [req-9b30101b-133c-4a65-8bf4-0a36ca02ecee req-19e1fe1d-1cf7-4da5-a683-80453f4e2f4a tempest-DeleteServersTestJSON-1018355336 tempest-DeleteServersTestJSON-1018355336-project-member] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1241.688185] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1241.688517] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.688648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.688723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.688950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.689149] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.689260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.689323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.689492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.689582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.689679] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.998097] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.998354] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.998489] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.998847] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.999283] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.999471] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.999599] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.999851] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.000015] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.000264] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1242.000447] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1242.000581] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1242.000956] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1242.000956] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1242.001074] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1242.001162] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1242.019785] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1242.019972] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1242.020142] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1242.020350] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.020726] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-d1ca1977-b8c4-40a5-948b-532cce47a8a9 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.020842] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-d1ca1977-b8c4-40a5-948b-532cce47a8a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.020974] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-d1ca1977-b8c4-40a5-948b-532cce47a8a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.021331] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-d1ca1977-b8c4-40a5-948b-532cce47a8a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.021481] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1ca1977-b8c4-40a5-948b-532cce47a8a9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.052043] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 in Status: SUCCESS [ 1242.052043] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 deletion is rescheduled due to dependency. [ 1242.052043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.192667] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.192667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.192667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.192667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.192667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.192982] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.192982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.192982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.193186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.193186] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.193253] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1242.220990] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.221210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.221254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.221615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.221831] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.230321] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1242.524056] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.524287] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.524428] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.524728] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.524888] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.525062] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port d1ca1977-b8c4-40a5-948b-532cce47a8a9 not found, creating... [ 1242.525335] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.525513] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.525641] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.525903] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.526077] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.526386] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.526551] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.526681] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.526904] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.527065] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.527216] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: d1ca1977-b8c4-40a5-948b-532cce47a8a9 is going to be created. [ 1242.549910] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.550161] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.550322] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.550643] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.550905] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.551181] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-d1ca1977-b8c4-40a5-948b-532cce47a8a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.869689] env[69491]: INFO networking_nsxv3.common.synchronization [req-f81c8cfa-2bec-46a9-883e-3f093b0ab48f req-420fc197-0c1e-4763-97d3-86f6779e593c tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1242.870293] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1242.870598] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.870726] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.870794] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.870994] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.871166] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.871260] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.871313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.871460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.871544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.871634] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.259666] env[69491]: INFO networking_nsxv3.common.synchronization [req-9b30101b-133c-4a65-8bf4-0a36ca02ecee req-85fb6e36-45ab-4783-b890-d3f0722349ae service nova] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_rules [ 1243.259862] env[69491]: INFO networking_nsxv3.common.synchronization [req-9b30101b-133c-4a65-8bf4-0a36ca02ecee req-85fb6e36-45ab-4783-b890-d3f0722349ae service nova] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1243.260014] env[69491]: INFO networking_nsxv3.common.synchronization [req-9b30101b-133c-4a65-8bf4-0a36ca02ecee req-85fb6e36-45ab-4783-b890-d3f0722349ae service nova] Enqueued Resource ID: d1ca1977-b8c4-40a5-948b-532cce47a8a9 with Priority: HIGHEST for action port [ 1243.260271] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_rules [ 1243.260395] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1243.260487] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ca1977-b8c4-40a5-948b-532cce47a8a9 with Priority: HIGHEST for action port [ 1243.262913] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.263540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.263540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.263540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.263540] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.264513] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.265041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.265041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1ca1977-b8c4-40a5-948b-532cce47a8a9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.265041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1ca1977-b8c4-40a5-948b-532cce47a8a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.265041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1ca1977-b8c4-40a5-948b-532cce47a8a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.266073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1ca1977-b8c4-40a5-948b-532cce47a8a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.266073] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1ca1977-b8c4-40a5-948b-532cce47a8a9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.374829] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.767218] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.767218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.767503] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1ca1977-b8c4-40a5-948b-532cce47a8a9 with status ACTIVE [ 1243.767543] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.767703] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.767703] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.767939] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.768047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.768254] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.768359] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.768425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.768586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.768673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.768848] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.768945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.769017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.769165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.769241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.769327] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1ca1977-b8c4-40a5-948b-532cce47a8a9 is going to be updated. [ 1243.791683] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.791867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.791937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.792464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.792464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.792464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1ca1977-b8c4-40a5-948b-532cce47a8a9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.877415] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.022200] env[69491]: INFO networking_nsxv3.common.synchronization [req-b11243fd-efb6-49f2-991f-97b346a30a03 req-7eaa9561-be48-454c-b1e9-bc286a698ba8 tempest-ServersTestFqdnHostnames-398938474 tempest-ServersTestFqdnHostnames-398938474-project-member] Enqueued Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGHEST for action security_group_members [ 1244.022658] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGHEST for action security_group_members [ 1244.022970] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-64836ebf-8b10-4f23-98d0-28aef1aadca7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.023113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.023182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.023471] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.023631] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.023714] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.023769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.023920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.024011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.028148] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64836ebf-8b10-4f23-98d0-28aef1aadca7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.240404] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1244.240603] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d deletion is rescheduled due to dependency. [ 1244.240722] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.240901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.241153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.241493] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.241493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.241625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.241661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.241745] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.241838] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.373376] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-316 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.373690] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-316" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.373879] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-316" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.375394] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-316" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.375701] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.375882] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.376029] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.376627] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.376627] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.376902] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.376902] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.377116] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.377311] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.377460] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.377588] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.377734] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.379427] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.379550] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.379613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.379801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.379893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.380057] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1244.410609] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.410814] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1244.410968] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.411318] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-316" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.411668] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-968ed01f-ffcd-47fb-a707-58277db9cef1 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.411875] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-968ed01f-ffcd-47fb-a707-58277db9cef1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.412021] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-968ed01f-ffcd-47fb-a707-58277db9cef1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.412375] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-968ed01f-ffcd-47fb-a707-58277db9cef1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.412543] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('968ed01f-ffcd-47fb-a707-58277db9cef1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.421795] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.421944] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.422030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.422299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.422422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.434112] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1244.535095] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.535095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.535095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.535095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.535095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.535570] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.535570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.535570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.535570] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.535743] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.535743] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 already deleted. [ 1244.535927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.744730] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.917520] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.917967] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.917967] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.918332] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.918504] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.918679] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 968ed01f-ffcd-47fb-a707-58277db9cef1 not found, creating... [ 1244.919039] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.919154] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.919278] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.919526] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.919673] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.919988] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.920178] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.920306] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.920597] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.920753] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.920906] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 968ed01f-ffcd-47fb-a707-58277db9cef1 is going to be created. [ 1244.941676] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.941925] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.942062] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.942405] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.942626] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.942962] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-968ed01f-ffcd-47fb-a707-58277db9cef1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.247377] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.751057] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.751266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.751342] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.751582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.752045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.752045] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1245.770839] env[69491]: INFO networking_nsxv3.common.synchronization [req-b11243fd-efb6-49f2-991f-97b346a30a03 req-2a990156-2846-4b7d-8b2b-ee7b83550941 service nova] Enqueued Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGHEST for action security_group_rules [ 1245.771045] env[69491]: INFO networking_nsxv3.common.synchronization [req-b11243fd-efb6-49f2-991f-97b346a30a03 req-2a990156-2846-4b7d-8b2b-ee7b83550941 service nova] Enqueued Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGHEST for action security_group_members [ 1245.771206] env[69491]: INFO networking_nsxv3.common.synchronization [req-b11243fd-efb6-49f2-991f-97b346a30a03 req-2a990156-2846-4b7d-8b2b-ee7b83550941 service nova] Enqueued Resource ID: 968ed01f-ffcd-47fb-a707-58277db9cef1 with Priority: HIGHEST for action port [ 1245.771724] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGHEST for action security_group_rules [ 1245.771860] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGHEST for action security_group_members [ 1245.771961] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 968ed01f-ffcd-47fb-a707-58277db9cef1 with Priority: HIGHEST for action port [ 1245.772287] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64836ebf-8b10-4f23-98d0-28aef1aadca7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.772407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.772483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.772724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.772806] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64836ebf-8b10-4f23-98d0-28aef1aadca7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.774423] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-64836ebf-8b10-4f23-98d0-28aef1aadca7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.774543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.774632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.774985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.774985] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.775134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.775134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.775297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.775297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.775415] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64836ebf-8b10-4f23-98d0-28aef1aadca7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.776189] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-968ed01f-ffcd-47fb-a707-58277db9cef1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.776310] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-968ed01f-ffcd-47fb-a707-58277db9cef1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.776448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-968ed01f-ffcd-47fb-a707-58277db9cef1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.776522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-968ed01f-ffcd-47fb-a707-58277db9cef1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.776598] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('968ed01f-ffcd-47fb-a707-58277db9cef1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.779583] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.779820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.779935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.780167] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.780926] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.793063] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1246.278552] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-64836ebf-8b10-4f23-98d0-28aef1aadca7 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.279089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.279089] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64836ebf-8b10-4f23-98d0-28aef1aadca7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.279925] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 968ed01f-ffcd-47fb-a707-58277db9cef1 with status ACTIVE [ 1246.280198] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.280198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.280468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.280468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.280540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.280694] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.280777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.280839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.281033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.281125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.281358] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.281536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.281591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.282037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.282037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.282037] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 968ed01f-ffcd-47fb-a707-58277db9cef1 is going to be updated. [ 1246.304859] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.305036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.305099] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.305295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.305434] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.305607] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-968ed01f-ffcd-47fb-a707-58277db9cef1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.448400] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1246.448675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.784865] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64836ebf-8b10-4f23-98d0-28aef1aadca7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.288388] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.288763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.288763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.289108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.289200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.289290] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 is going to be created. [ 1247.325029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.325029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.325029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.325029] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.325335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.335532] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 in Status: UNINITIALIZED for 2s [ 1247.804529] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1247.804716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.804900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.805145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.805376] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.805503] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.805560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.805732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.805880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.806010] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.806117] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.308827] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.309375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.309375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.309375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.309532] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.309770] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.309770] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.309936] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.309936] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.310052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.310176] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.310304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.310368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.310511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.310651] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.310746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.310819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.310938] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.311024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.311125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.311222] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.813594] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d: rpc.has_security_group_logging(os_id): False [ 1248.844988] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.844988] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.844988] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.844988] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.844988] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.845369] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.845369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.845369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.845369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.845532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.845638] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.845876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.845954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.846121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.846242] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.846461] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.846595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.846695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.846872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.846979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.847109] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1248.918222] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.918505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.918505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.918748] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.918981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.936529] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1249.346315] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 in Status: SUCCESS [ 1249.346731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.346731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.346947] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.347171] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.347305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.347369] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.347541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.347624] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.347793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.347793] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64836ebf-8b10-4f23-98d0-28aef1aadca7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.850981] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64836ebf-8b10-4f23-98d0-28aef1aadca7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.353835] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64836ebf-8b10-4f23-98d0-28aef1aadca7: rpc.has_security_group_logging(os_id): False [ 1250.379514] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.379880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.379880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.380070] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.380185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.380554] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.380661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.380767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.380942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.381043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.381136] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 is going to be created. [ 1250.450285] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.450467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.450534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.450786] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.450970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.470093] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 in Status: IN_PROGRESS for 2s [ 1250.699885] env[69491]: INFO networking_nsxv3.common.synchronization [req-ce93cd32-bcc3-424c-8eb7-8538419e0a62 req-f9a5b2a8-1693-41bb-8365-e08cd394160f tempest-ServersTestJSON-1152730972 tempest-ServersTestJSON-1152730972-project-member] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1250.700731] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGHEST for action security_group_members [ 1250.705494] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.705494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.705494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.705494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.705494] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.705494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.705494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.705494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.705494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.706035] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.964514] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1250.964778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.208167] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.208425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.208564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.208733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.208842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.209101] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.209245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.209355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.209610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.209750] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.209890] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be updated. [ 1251.247457] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.247457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.247457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.247457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.247457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.255720] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: IN_PROGRESS for 2s [ 1252.483147] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 in Status: SUCCESS [ 1252.483147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.267882] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 in Status: SUCCESS [ 1253.268070] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 deletion is rescheduled due to dependency. [ 1253.268235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.889204] env[69491]: INFO networking_nsxv3.common.synchronization [None req-f6a876c6-c1bb-4765-b53f-9863fe2ab7e5 None None] Enqueued Resource ID: 16f974a4-20e2-4c97-bdb1-cf479871e664 with Priority: HIGHEST for action port [ 1253.889746] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f974a4-20e2-4c97-bdb1-cf479871e664 with Priority: HIGHEST for action port [ 1253.890076] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-16f974a4-20e2-4c97-bdb1-cf479871e664 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.890209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16f974a4-20e2-4c97-bdb1-cf479871e664" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.890278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16f974a4-20e2-4c97-bdb1-cf479871e664" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.890749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16f974a4-20e2-4c97-bdb1-cf479871e664" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.890749] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16f974a4-20e2-4c97-bdb1-cf479871e664',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.392272] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16f974a4-20e2-4c97-bdb1-cf479871e664 [ 1254.395508] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.395508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.395508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.395508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.395508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.395508] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16f974a4-20e2-4c97-bdb1-cf479871e664 already deleted. [ 1254.395508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16f974a4-20e2-4c97-bdb1-cf479871e664" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.201809] env[69491]: INFO networking_nsxv3.common.synchronization [None req-377763bd-9003-4260-aede-1472d471938e None None] Enqueued Resource ID: f0ade16e-a81c-46ca-9083-4ef989d35300 with Priority: HIGHEST for action port [ 1256.203414] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0ade16e-a81c-46ca-9083-4ef989d35300 with Priority: HIGHEST for action port [ 1256.203414] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0ade16e-a81c-46ca-9083-4ef989d35300 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.203414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0ade16e-a81c-46ca-9083-4ef989d35300" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.203414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0ade16e-a81c-46ca-9083-4ef989d35300" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.206015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0ade16e-a81c-46ca-9083-4ef989d35300" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.206015] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0ade16e-a81c-46ca-9083-4ef989d35300',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.710018] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0ade16e-a81c-46ca-9083-4ef989d35300 [ 1256.710018] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.710018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.710018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.710018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.710018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.710018] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0ade16e-a81c-46ca-9083-4ef989d35300 already deleted. [ 1256.710018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0ade16e-a81c-46ca-9083-4ef989d35300" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.218576] env[69491]: INFO networking_nsxv3.common.synchronization [req-2aaaeafb-a95b-485c-a2e9-38f4765d383b req-951258c4-bea8-4784-aa1c-66e28a179874 tempest-DeleteServersTestJSON-1018355336 tempest-DeleteServersTestJSON-1018355336-project-member] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1257.219158] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1257.219463] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.219586] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.219655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.219856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.220015] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.220121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.220184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.220352] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.220438] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.220531] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.722512] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.722737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.722816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.723019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.723110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.723318] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.723416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.723479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.723631] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.723708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.723794] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1257.751687] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.751885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.751937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.752125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.752267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.760568] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1259.417881] env[69491]: INFO networking_nsxv3.common.synchronization [req-81cbe592-f391-4008-9b19-75c8e0bbecb0 req-aa3efa87-ce2f-4647-b2c0-22fcd9206fdd tempest-ServerAddressesTestJSON-1831517925 tempest-ServerAddressesTestJSON-1831517925-project-member] Enqueued Resource ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 with Priority: HIGHEST for action security_group_members [ 1259.418517] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 with Priority: HIGHEST for action security_group_members [ 1259.418967] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e544cb2-f99f-4d89-9314-20a97f2f4942 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.419142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.419241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.419473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.419634] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.419753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.419854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.420041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.420148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.420248] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e544cb2-f99f-4d89-9314-20a97f2f4942',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.712757] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-456 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.712757] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-456" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.712757] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-456" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.713052] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-456" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.713327] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.713486] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.713609] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.713832] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.713982] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.714218] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1259.714338] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1259.714456] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1259.714574] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1259.714692] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1259.714806] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1259.714942] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1259.735459] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1259.735769] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1259.735876] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1259.736013] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-456" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.736368] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-e64491fb-8e2e-4ef7-bfb2-ba5306330f97 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.736555] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-e64491fb-8e2e-4ef7-bfb2-ba5306330f97" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.736687] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-e64491fb-8e2e-4ef7-bfb2-ba5306330f97" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.737041] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-e64491fb-8e2e-4ef7-bfb2-ba5306330f97" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.737194] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64491fb-8e2e-4ef7-bfb2-ba5306330f97',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.770582] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1259.770780] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d deletion is rescheduled due to dependency. [ 1259.770924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.922388] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.922594] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.922702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.923046] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.923091] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.923333] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.923474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.923565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.923779] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.923882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.923975] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 already deleted. [ 1259.924077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.240086] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.240409] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.241933] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.241933] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.241933] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.241933] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port e64491fb-8e2e-4ef7-bfb2-ba5306330f97 not found, creating... [ 1260.241933] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.241933] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.241933] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.242317] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.242317] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.242590] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.242764] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.242892] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.243135] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.243299] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.243450] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: e64491fb-8e2e-4ef7-bfb2-ba5306330f97 is going to be created. [ 1260.265987] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.266264] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.266375] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.266698] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.266960] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.267225] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-e64491fb-8e2e-4ef7-bfb2-ba5306330f97" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.641021] env[69491]: INFO networking_nsxv3.common.synchronization [req-4cee4b32-91dc-4e00-9396-f954dcc5bf28 req-79ca3124-3ce1-41e8-904d-c001c112a68e tempest-AttachVolumeNegativeTest-483714092 tempest-AttachVolumeNegativeTest-483714092-project-member] Enqueued Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGHEST for action security_group_members [ 1260.641021] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGHEST for action security_group_members [ 1260.641021] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-57114c60-305d-46b5-a583-fad2bd258d54 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.641021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.641021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.641021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.641021] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.641021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.641021] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.641848] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.642055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.642269] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57114c60-305d-46b5-a583-fad2bd258d54',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.016161] env[69491]: INFO networking_nsxv3.common.synchronization [req-81cbe592-f391-4008-9b19-75c8e0bbecb0 req-df95c118-ee8f-4c7a-ba1c-9ed0aec554fa service nova] Enqueued Resource ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 with Priority: HIGHEST for action security_group_rules [ 1261.016161] env[69491]: INFO networking_nsxv3.common.synchronization [req-81cbe592-f391-4008-9b19-75c8e0bbecb0 req-df95c118-ee8f-4c7a-ba1c-9ed0aec554fa service nova] Enqueued Resource ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 with Priority: HIGHEST for action security_group_members [ 1261.016161] env[69491]: INFO networking_nsxv3.common.synchronization [req-81cbe592-f391-4008-9b19-75c8e0bbecb0 req-df95c118-ee8f-4c7a-ba1c-9ed0aec554fa service nova] Enqueued Resource ID: e64491fb-8e2e-4ef7-bfb2-ba5306330f97 with Priority: HIGHEST for action port [ 1261.016161] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 with Priority: HIGHEST for action security_group_rules [ 1261.016161] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 with Priority: HIGHEST for action security_group_members [ 1261.016161] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64491fb-8e2e-4ef7-bfb2-ba5306330f97 with Priority: HIGHEST for action port [ 1261.017799] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e544cb2-f99f-4d89-9314-20a97f2f4942 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.018225] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.018555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.019028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.019264] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e544cb2-f99f-4d89-9314-20a97f2f4942',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.020314] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e544cb2-f99f-4d89-9314-20a97f2f4942 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.020562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.020716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.020980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.021301] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.022022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.022022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.022022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.022022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.022022] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e544cb2-f99f-4d89-9314-20a97f2f4942',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.023203] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-e64491fb-8e2e-4ef7-bfb2-ba5306330f97 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.023489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e64491fb-8e2e-4ef7-bfb2-ba5306330f97" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.025204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e64491fb-8e2e-4ef7-bfb2-ba5306330f97" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.025204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e64491fb-8e2e-4ef7-bfb2-ba5306330f97" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.025204] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64491fb-8e2e-4ef7-bfb2-ba5306330f97',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.145068] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.145068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.145068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.145416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.146334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.146583] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.146701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.146764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.146950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.147052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.147150] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57114c60-305d-46b5-a583-fad2bd258d54 is going to be updated. [ 1261.175866] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.176089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.176089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.176295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.176447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.184865] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57114c60-305d-46b5-a583-fad2bd258d54 in Status: IN_PROGRESS for 2s [ 1261.525711] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e544cb2-f99f-4d89-9314-20a97f2f4942 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.525871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.526189] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e544cb2-f99f-4d89-9314-20a97f2f4942',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.527138] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e64491fb-8e2e-4ef7-bfb2-ba5306330f97 with status ACTIVE [ 1261.527638] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.527638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.527638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.528087] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.528087] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.528087] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.528361] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.528361] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.528361] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.528519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.528600] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.528696] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.528751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.528893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.528966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.529201] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e64491fb-8e2e-4ef7-bfb2-ba5306330f97 is going to be updated. [ 1261.550224] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.550382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.550486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.550737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.550899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.551116] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e64491fb-8e2e-4ef7-bfb2-ba5306330f97" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.031472] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e544cb2-f99f-4d89-9314-20a97f2f4942',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.533778] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.535564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.535564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.535564] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.535724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.535724] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 is going to be created. [ 1262.565047] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.565246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.565297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.565490] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.565651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.575248] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 in Status: UNINITIALIZED for 2s [ 1263.194913] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57114c60-305d-46b5-a583-fad2bd258d54 in Status: SUCCESS [ 1263.194913] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57114c60-305d-46b5-a583-fad2bd258d54 deletion is rescheduled due to dependency. [ 1263.195339] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.585073] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 in Status: SUCCESS [ 1264.585432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.585492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.585673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.585883] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.586470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.586470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.586470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.586470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.586470] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.586732] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e544cb2-f99f-4d89-9314-20a97f2f4942',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.088796] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e544cb2-f99f-4d89-9314-20a97f2f4942 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.089012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.089131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.089363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.089540] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.090360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.090360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.090360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.090360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.090360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.090360] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e544cb2-f99f-4d89-9314-20a97f2f4942 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.090360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.090360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.090737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.090737] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.090737] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.090868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.090937] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.091018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.091110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.091218] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e544cb2-f99f-4d89-9314-20a97f2f4942',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.594194] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e544cb2-f99f-4d89-9314-20a97f2f4942: rpc.has_security_group_logging(os_id): False [ 1265.620518] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.620767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.620818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.621014] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.621113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.621322] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.621646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.621646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.621747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.621747] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.621940] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.622050] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.622105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.622308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.622473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.622717] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.622849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.622942] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.623138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.623244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.623360] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 is going to be created. [ 1265.695202] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.695485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.695485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.695660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.695851] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.707966] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 in Status: IN_PROGRESS for 2s [ 1266.016828] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1266.017084] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1267.041693] env[69491]: INFO networking_nsxv3.common.synchronization [req-942ec0cb-45e5-46d9-93ba-fe36130b7386 req-aba91bf8-bf72-4f9d-b0c8-e6d4dfa0dac7 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGHEST for action security_group_members [ 1267.041980] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGHEST for action security_group_members [ 1267.042320] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2757bc9-a946-4a06-ad40-4649502b2e59 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.042457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.042525] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.042756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.042866] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.042960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.043032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.043181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.043529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.043529] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2757bc9-a946-4a06-ad40-4649502b2e59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.548089] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.548089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.548089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.548396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.548437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.548617] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.548716] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.548780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.548933] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.549051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.549168] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2757bc9-a946-4a06-ad40-4649502b2e59 is going to be updated. [ 1267.579110] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.579319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.579319] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.579454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.579904] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.589231] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2757bc9-a946-4a06-ad40-4649502b2e59 in Status: IN_PROGRESS for 2s [ 1267.720380] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 in Status: SUCCESS [ 1267.720761] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.048435] env[69491]: INFO networking_nsxv3.common.synchronization [req-9b510333-1e8f-408f-a3f3-4d23a1746946 req-bab53ace-9fbc-46c8-8e44-f52f1d52fd7c tempest-DeleteServersTestJSON-1018355336 tempest-DeleteServersTestJSON-1018355336-project-member] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1268.048768] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1268.048893] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.049200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.049279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.049507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.049684] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.049793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.049858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.050032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.050124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.050226] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.331852] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.332075] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.332214] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.332498] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.332774] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.332940] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.333081] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.333324] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.333510] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.333699] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1268.333877] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1268.333962] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1268.334093] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1268.334264] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1268.334399] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1268.334545] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1268.357077] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1268.357243] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1268.357310] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1268.357463] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-787" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.357823] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-2d3bff42-19e0-4ebe-a75c-a8b21adaafaa taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.358052] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-2d3bff42-19e0-4ebe-a75c-a8b21adaafaa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.358206] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-2d3bff42-19e0-4ebe-a75c-a8b21adaafaa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.358549] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-2d3bff42-19e0-4ebe-a75c-a8b21adaafaa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.358699] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d3bff42-19e0-4ebe-a75c-a8b21adaafaa',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.553557] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.553773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.553773] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.554052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.554160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.554360] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.554466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.554531] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.554695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.554775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.554862] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1268.581755] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.582033] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.582115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.582341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.582491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.591778] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1268.860858] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.861178] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.861347] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.861705] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.861901] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.862089] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 2d3bff42-19e0-4ebe-a75c-a8b21adaafaa not found, creating... [ 1268.862383] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.862557] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.862689] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.862939] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.863106] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.863438] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.863608] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.863736] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.863963] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.864120] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.864301] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 2d3bff42-19e0-4ebe-a75c-a8b21adaafaa is going to be created. [ 1268.893118] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.893430] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.893655] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.894094] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.894476] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.894802] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-2d3bff42-19e0-4ebe-a75c-a8b21adaafaa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.599859] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2757bc9-a946-4a06-ad40-4649502b2e59 in Status: SUCCESS [ 1269.600280] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2757bc9-a946-4a06-ad40-4649502b2e59 deletion is rescheduled due to dependency. [ 1269.600341] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.608761] env[69491]: INFO networking_nsxv3.common.synchronization [req-9b510333-1e8f-408f-a3f3-4d23a1746946 req-6ef975e8-6970-438c-b37b-01f6eac9be69 service nova] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_rules [ 1269.609156] env[69491]: INFO networking_nsxv3.common.synchronization [req-9b510333-1e8f-408f-a3f3-4d23a1746946 req-6ef975e8-6970-438c-b37b-01f6eac9be69 service nova] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1269.609539] env[69491]: INFO networking_nsxv3.common.synchronization [req-9b510333-1e8f-408f-a3f3-4d23a1746946 req-6ef975e8-6970-438c-b37b-01f6eac9be69 service nova] Enqueued Resource ID: 2d3bff42-19e0-4ebe-a75c-a8b21adaafaa with Priority: HIGHEST for action port [ 1269.610333] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_rules [ 1269.610497] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1269.610662] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3bff42-19e0-4ebe-a75c-a8b21adaafaa with Priority: HIGHEST for action port [ 1269.611212] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.611305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.611375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.611693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.611831] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.613297] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.613396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.613652] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d3bff42-19e0-4ebe-a75c-a8b21adaafaa taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.613813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d3bff42-19e0-4ebe-a75c-a8b21adaafaa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.613918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d3bff42-19e0-4ebe-a75c-a8b21adaafaa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.614204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d3bff42-19e0-4ebe-a75c-a8b21adaafaa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.614332] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d3bff42-19e0-4ebe-a75c-a8b21adaafaa',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.115910] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.116085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.119081] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d3bff42-19e0-4ebe-a75c-a8b21adaafaa with status ACTIVE [ 1270.119081] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.119081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.119081] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.119362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.119404] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.119599] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.119706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.119770] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.119931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.120026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.120216] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.120313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.120466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.120526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.120599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.120684] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d3bff42-19e0-4ebe-a75c-a8b21adaafaa is going to be updated. [ 1270.143535] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.143755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.143755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.144022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.144120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.144285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d3bff42-19e0-4ebe-a75c-a8b21adaafaa" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.603315] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1270.603580] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d deletion is rescheduled due to dependency. [ 1270.603580] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.603689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.604312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.604312] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.604312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.604544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.604544] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.605424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.605424] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.106946] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.609192] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.111726] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.111929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.111976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.112462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.112571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.112675] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1272.149935] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.150154] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.150200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.150418] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.150582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.160014] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1274.174494] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1274.174850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.174906] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.175817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.175817] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.175817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.175817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.175817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.175817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.175817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.176866] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.270168] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.270168] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.270168] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.270347] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.270487] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.270655] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.270781] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.271159] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.271450] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.271723] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1274.271932] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.272233] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.272374] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.272507] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1274.272626] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.272768] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.293128] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.293319] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1274.293639] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.293639] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.293965] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.294162] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.294291] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.294564] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.294705] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcf06d4a-f85a-4a4d-8a64-7070b4da45f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.611704] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.611704] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1274.678364] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.678553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.678553] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.678808] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.679539] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.679539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.679539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.679539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.679539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.679539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.679539] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.679890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.679890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.679890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.679996] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.680057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.680095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.680208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.680278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.680371] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.680463] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.796983] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.797309] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.797468] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.797760] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.797920] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.798286] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.798455] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.798584] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.798816] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.798969] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.799285] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.799452] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.799578] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.799799] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.799942] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.800106] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 is going to be updated. [ 1274.821349] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.821584] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.821719] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.822029] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.822242] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.822482] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.182659] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d: rpc.has_security_group_logging(os_id): False [ 1275.201173] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.201403] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.201403] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.201625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.201734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.201984] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.202105] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.202172] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.202349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.202437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.202634] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.202733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.202795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.202941] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.203030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.203227] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.203324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.203384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.203524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.203599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.203686] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1275.270255] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.270469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.270558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.270838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.271054] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.288399] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1275.549355] env[69491]: INFO networking_nsxv3.common.synchronization [req-efb30405-ecac-48b5-9570-36841916aa62 req-8a3e393a-1f38-4d73-a168-6012d2519f56 service nova] Enqueued Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_rules [ 1275.549355] env[69491]: INFO networking_nsxv3.common.synchronization [req-efb30405-ecac-48b5-9570-36841916aa62 req-8a3e393a-1f38-4d73-a168-6012d2519f56 service nova] Enqueued Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_members [ 1275.549355] env[69491]: INFO networking_nsxv3.common.synchronization [req-efb30405-ecac-48b5-9570-36841916aa62 req-8a3e393a-1f38-4d73-a168-6012d2519f56 service nova] Enqueued Resource ID: bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 with Priority: HIGHEST for action port [ 1275.549355] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_rules [ 1275.549355] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_members [ 1275.549355] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 with Priority: HIGHEST for action port [ 1275.549355] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.549355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.549355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.549355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.549812] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.550427] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.550565] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.550636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.550826] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.551041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.551148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.551235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.551396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.551485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.551610] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.552437] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.552547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.556024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.556024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.556024] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcf06d4a-f85a-4a4d-8a64-7070b4da45f9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.054771] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.054946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.055081] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.056015] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 with status ACTIVE [ 1276.056215] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.056334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.056404] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.056613] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.056703] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.056872] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.056968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.057048] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.057208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.057286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.057467] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.057562] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.057623] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.057764] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.057839] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.057925] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcf06d4a-f85a-4a4d-8a64-7070b4da45f9 is going to be updated. [ 1276.079885] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.080065] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.080120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.080364] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.080496] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.080660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcf06d4a-f85a-4a4d-8a64-7070b4da45f9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.560250] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.063136] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.063481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.063888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.064019] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.064079] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.064162] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da83f74d-33e1-4838-a0f1-70f509a0a68c is going to be updated. [ 1277.093800] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.094056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.094163] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.094483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.094708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.106936] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da83f74d-33e1-4838-a0f1-70f509a0a68c in Status: IN_PROGRESS for 2s [ 1277.313136] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1277.313136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.366835] env[69491]: INFO networking_nsxv3.common.synchronization [req-9ee0fb95-ed02-4494-aae0-be355afe5915 req-c37def15-dee3-420d-9525-d9c809c292b4 tempest-ServerAddressesTestJSON-1831517925 tempest-ServerAddressesTestJSON-1831517925-project-member] Enqueued Resource ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 with Priority: HIGHEST for action security_group_members [ 1277.367788] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 with Priority: HIGHEST for action security_group_members [ 1277.367788] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e544cb2-f99f-4d89-9314-20a97f2f4942 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.367989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.367989] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.368226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.368317] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.368454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.368454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.368683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.368770] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.368864] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e544cb2-f99f-4d89-9314-20a97f2f4942',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.871684] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.872039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.872039] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.872241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.872335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.872552] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.872661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.872723] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.872948] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.873051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.873153] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 is going to be updated. [ 1277.902899] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.903098] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.903199] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.903439] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.903627] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.912064] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 in Status: IN_PROGRESS for 2s [ 1279.116758] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da83f74d-33e1-4838-a0f1-70f509a0a68c in Status: SUCCESS [ 1279.117153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.117201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.117421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.117615] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.117898] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.117967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.118349] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.118448] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.118483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.118567] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.621071] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.922408] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 in Status: SUCCESS [ 1279.922619] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 deletion is rescheduled due to dependency. [ 1279.922706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.123824] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da83f74d-33e1-4838-a0f1-70f509a0a68c: rpc.has_security_group_logging(os_id): False [ 1280.143548] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.143822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.143822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.143959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.143959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.144229] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.144365] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.144408] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.144683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.144683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.144874] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da83f74d-33e1-4838-a0f1-70f509a0a68c is going to be updated. [ 1280.206634] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.206846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.206846] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.207096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.207247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.219812] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da83f74d-33e1-4838-a0f1-70f509a0a68c in Status: IN_PROGRESS for 2s [ 1281.210745] env[69491]: INFO networking_nsxv3.common.synchronization [req-a8edc125-90e7-42fd-bc6a-cc60f5a9cb4a req-c8580811-bf31-43a6-b88e-5da175333e46 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_members [ 1281.211441] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_members [ 1281.211710] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.211842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.211914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.212135] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.212322] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.212429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.212520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.213693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.213693] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.213693] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.489511] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.489715] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.489846] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.490143] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.490441] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.490624] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.490781] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.491061] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.491220] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.491443] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1281.491561] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1281.491676] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1281.491790] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1281.491969] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1281.492136] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1281.492284] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1281.511568] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1281.511728] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1281.511873] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1281.512064] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.512858] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-d974787a-88d2-4e09-992a-111a107cf338 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.513095] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-d974787a-88d2-4e09-992a-111a107cf338" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.513238] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-d974787a-88d2-4e09-992a-111a107cf338" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.513574] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-d974787a-88d2-4e09-992a-111a107cf338" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.513722] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d974787a-88d2-4e09-992a-111a107cf338',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.715068] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.715414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.715414] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.715833] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.715981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.716272] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.716441] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.716551] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.716825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.716971] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.717151] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 is going to be updated. [ 1281.748793] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.749122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.749278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.749490] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.749729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.759912] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: IN_PROGRESS for 2s [ 1282.016280] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.016574] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.016715] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.017021] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.017181] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.017347] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port d974787a-88d2-4e09-992a-111a107cf338 not found, creating... [ 1282.017674] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.017847] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.018107] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.018368] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.018573] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.018879] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.019182] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.019459] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.019773] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.019937] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.020110] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: d974787a-88d2-4e09-992a-111a107cf338 is going to be created. [ 1282.041795] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.042032] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.042169] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.042595] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.042859] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.043120] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-d974787a-88d2-4e09-992a-111a107cf338" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.234833] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da83f74d-33e1-4838-a0f1-70f509a0a68c in Status: SUCCESS [ 1282.235271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.751261] env[69491]: INFO networking_nsxv3.common.synchronization [req-a8edc125-90e7-42fd-bc6a-cc60f5a9cb4a req-7071318f-217e-41de-a9d9-52c28a2620a2 service nova] Enqueued Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_rules [ 1282.751439] env[69491]: INFO networking_nsxv3.common.synchronization [req-a8edc125-90e7-42fd-bc6a-cc60f5a9cb4a req-7071318f-217e-41de-a9d9-52c28a2620a2 service nova] Enqueued Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_members [ 1282.751583] env[69491]: INFO networking_nsxv3.common.synchronization [req-a8edc125-90e7-42fd-bc6a-cc60f5a9cb4a req-7071318f-217e-41de-a9d9-52c28a2620a2 service nova] Enqueued Resource ID: d974787a-88d2-4e09-992a-111a107cf338 with Priority: HIGHEST for action port [ 1282.752158] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_rules [ 1282.752280] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_members [ 1282.752384] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d974787a-88d2-4e09-992a-111a107cf338 with Priority: HIGHEST for action port [ 1282.752669] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.752795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.752868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.753145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.753233] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.754198] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.754299] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.754513] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d974787a-88d2-4e09-992a-111a107cf338 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.754691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d974787a-88d2-4e09-992a-111a107cf338" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.754814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d974787a-88d2-4e09-992a-111a107cf338" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.754946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d974787a-88d2-4e09-992a-111a107cf338" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.755099] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d974787a-88d2-4e09-992a-111a107cf338',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.259192] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d974787a-88d2-4e09-992a-111a107cf338 with status ACTIVE [ 1283.259573] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.259650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.259692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.259893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.259988] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.260201] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.260307] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.260373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.260608] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.260608] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.260778] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.260882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.260923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.261147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.261211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.261310] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d974787a-88d2-4e09-992a-111a107cf338 is going to be updated. [ 1283.262491] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.262603] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.284965] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.284965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.284965] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.285284] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.285432] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.285582] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d974787a-88d2-4e09-992a-111a107cf338" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.771106] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: SUCCESS [ 1283.771309] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 deletion is rescheduled due to dependency. [ 1283.771975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.771975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.771975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.771975] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.772252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.772252] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.772327] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.772413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.772630] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.277830] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.781245] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.284466] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.284853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.284853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.285051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.285151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.285258] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 is going to be updated. [ 1285.312150] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.312398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.312398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.312599] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.312751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.321504] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: IN_PROGRESS for 2s [ 1287.333821] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: SUCCESS [ 1287.334226] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.334268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.334591] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.334848] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.335015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.335121] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.335351] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.335464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.335580] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.335742] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.753394] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1287.753394] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1287.838150] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.838380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.838430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.838778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.838885] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.838952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.839045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.839227] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.839326] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.839415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.839689] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.839689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.839797] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.839894] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.840064] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.840168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.840234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.840380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.840473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.840567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.840661] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.343449] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbb08221-1c71-4b91-a7dd-598e8bbc7914: rpc.has_security_group_logging(os_id): False [ 1288.360734] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.360979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.360979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.361279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.361404] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.361661] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.361823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.361910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.362113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.362224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.362430] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.362555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.362637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.362842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.362954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.363175] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.363344] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.363410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.363554] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.363643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.363738] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 is going to be updated. [ 1288.426802] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.427036] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.427096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.427375] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.427587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.445493] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: IN_PROGRESS for 2s [ 1290.461272] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: SUCCESS [ 1290.461272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.533918] env[69491]: INFO networking_nsxv3.common.synchronization [req-18aea07d-079d-4c0b-978b-fc26c15e1681 req-a4106bd3-35e6-478a-a9a7-10569d2a1849 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_members [ 1291.534631] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGHEST for action security_group_members [ 1291.535086] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.535086] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.535086] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.535324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.535449] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.535657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.535657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.535800] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.535952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.535952] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.624940] env[69491]: INFO networking_nsxv3.common.synchronization [req-18aea07d-079d-4c0b-978b-fc26c15e1681 req-a4106bd3-35e6-478a-a9a7-10569d2a1849 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: d974787a-88d2-4e09-992a-111a107cf338 with Priority: HIGHEST for action port [ 1291.625508] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d974787a-88d2-4e09-992a-111a107cf338 with Priority: HIGHEST for action port [ 1291.625905] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-d974787a-88d2-4e09-992a-111a107cf338 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.626580] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d974787a-88d2-4e09-992a-111a107cf338" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.626679] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d974787a-88d2-4e09-992a-111a107cf338" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.627012] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d974787a-88d2-4e09-992a-111a107cf338" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.627012] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d974787a-88d2-4e09-992a-111a107cf338',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.038517] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.038738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.038793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.039324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.039324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.039535] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.039535] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.039817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.039817] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.039896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.039955] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 is going to be updated. [ 1292.069817] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.069998] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.070056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.070254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.070399] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.079661] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: IN_PROGRESS for 2s [ 1292.132856] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d974787a-88d2-4e09-992a-111a107cf338 with status ACTIVE [ 1292.132856] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.132856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.132856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.132856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.134118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.134118] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.134118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.134118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.134118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.134118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.134118] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.134118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.134118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.134118] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.134521] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.134521] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d974787a-88d2-4e09-992a-111a107cf338 is going to be updated. [ 1292.155351] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.155513] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.155590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.155801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.156428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.156428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d974787a-88d2-4e09-992a-111a107cf338" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.670360] env[69491]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1293.670870] env[69491]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1294.089708] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 in Status: SUCCESS [ 1294.089893] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 deletion is rescheduled due to dependency. [ 1294.090027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.396113] env[69491]: INFO networking_nsxv3.common.synchronization [req-981b9274-54d7-4d00-9c05-1a165f1d391f req-dfb110b7-85ae-44c6-97de-eb301d1903e3 tempest-ServersTestFqdnHostnames-398938474 tempest-ServersTestFqdnHostnames-398938474-project-member] Enqueued Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGHEST for action security_group_members [ 1294.396674] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGHEST for action security_group_members [ 1294.396995] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-64836ebf-8b10-4f23-98d0-28aef1aadca7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.397142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.397205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.397400] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.397553] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.397650] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.397707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.398535] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.398656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.398816] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64836ebf-8b10-4f23-98d0-28aef1aadca7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.902528] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.902878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.902878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.903032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.903155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.903348] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.903446] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.903514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.903698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.903815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.903859] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 is going to be updated. [ 1294.931799] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.932027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.932027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.932436] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.932536] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.942315] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 in Status: IN_PROGRESS for 2s [ 1296.954954] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 in Status: SUCCESS [ 1296.955475] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 deletion is rescheduled due to dependency. [ 1296.955475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.397896] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1299.398545] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1304.398869] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1304.399311] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1309.400473] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1309.400853] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1309.878953] env[69491]: INFO networking_nsxv3.common.synchronization [req-6ad3167b-93e8-40ca-a19e-0fdccf0b9450 req-971c48a5-c2dd-4176-b38b-f24f55f44d28 tempest-DeleteServersTestJSON-1018355336 tempest-DeleteServersTestJSON-1018355336-project-member] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1309.879770] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGHEST for action security_group_members [ 1309.880824] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.880824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.880824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.880824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.880824] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.880824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.880824] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.881282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.881282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.881282] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.383195] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.383427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.383427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.383742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.383891] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.384064] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.384200] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.384255] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.384398] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.384476] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.384559] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be updated. [ 1310.414203] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.414625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.414625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.414625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.414753] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.424520] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: IN_PROGRESS for 2s [ 1312.436337] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d in Status: SUCCESS [ 1312.436337] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d deletion is rescheduled due to dependency. [ 1312.436777] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.881174] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.881579] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.876170] env[69491]: INFO networking_nsxv3.common.synchronization [req-af41d385-c29b-48bf-bb8c-ddb7f32d26fd req-d70501e9-3891-40ce-9ea9-2ac261febe63 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_members [ 1315.876549] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_members [ 1315.877561] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.877561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.877561] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.877774] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.877810] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.877893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.877955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.878131] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.878249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.878313] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.301923] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.302327] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.302327] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.302926] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.302926] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.303166] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.303166] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.303438] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.303528] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.303735] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1316.303858] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1316.303975] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1316.304124] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1316.304263] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1316.304382] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1316.304523] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1316.327631] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1316.327832] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1316.327961] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1316.328154] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-916" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.328579] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-075c59dc-6bd0-43a5-bce4-a241b73113a3 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.328768] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-075c59dc-6bd0-43a5-bce4-a241b73113a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.328900] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-075c59dc-6bd0-43a5-bce4-a241b73113a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.329267] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-075c59dc-6bd0-43a5-bce4-a241b73113a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.329522] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('075c59dc-6bd0-43a5-bce4-a241b73113a3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.382468] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.832364] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.832626] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.832894] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.833660] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.834988] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.834988] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 075c59dc-6bd0-43a5-bce4-a241b73113a3 not found, creating... [ 1316.834988] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.834988] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.835200] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.835446] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.835446] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.836152] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.836152] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.836152] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.836544] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.836544] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.836626] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 075c59dc-6bd0-43a5-bce4-a241b73113a3 is going to be created. [ 1316.858851] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.858851] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.858851] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.859691] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.859691] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.859691] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-075c59dc-6bd0-43a5-bce4-a241b73113a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.885026] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.387579] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.387579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.387579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.387579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.388026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.388026] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc is going to be updated. [ 1317.419663] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.419893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.419951] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.420145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.420295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.430177] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: IN_PROGRESS for 2s [ 1317.543590] env[69491]: INFO networking_nsxv3.common.synchronization [req-af41d385-c29b-48bf-bb8c-ddb7f32d26fd req-a38ec584-20ed-47e8-9b6d-c14cab932b2b service nova] Enqueued Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_rules [ 1317.543787] env[69491]: INFO networking_nsxv3.common.synchronization [req-af41d385-c29b-48bf-bb8c-ddb7f32d26fd req-a38ec584-20ed-47e8-9b6d-c14cab932b2b service nova] Enqueued Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_members [ 1317.543936] env[69491]: INFO networking_nsxv3.common.synchronization [req-af41d385-c29b-48bf-bb8c-ddb7f32d26fd req-a38ec584-20ed-47e8-9b6d-c14cab932b2b service nova] Enqueued Resource ID: 075c59dc-6bd0-43a5-bce4-a241b73113a3 with Priority: HIGHEST for action port [ 1317.544199] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_rules [ 1317.544329] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_members [ 1317.544423] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 075c59dc-6bd0-43a5-bce4-a241b73113a3 with Priority: HIGHEST for action port [ 1317.545014] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.545253] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.545333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.545556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.545642] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.549427] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.549427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.549427] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-075c59dc-6bd0-43a5-bce4-a241b73113a3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.549427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-075c59dc-6bd0-43a5-bce4-a241b73113a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.549427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-075c59dc-6bd0-43a5-bce4-a241b73113a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.549427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-075c59dc-6bd0-43a5-bce4-a241b73113a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.549427] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('075c59dc-6bd0-43a5-bce4-a241b73113a3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.048438] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.048660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.053021] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 075c59dc-6bd0-43a5-bce4-a241b73113a3 with status ACTIVE [ 1318.053222] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.053351] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.053424] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.053677] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.053776] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.053958] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.054075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.054140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.054295] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.054373] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.054554] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.054648] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.054713] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.054856] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.054929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.055024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 075c59dc-6bd0-43a5-bce4-a241b73113a3 is going to be updated. [ 1318.074947] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.075129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.075129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.075337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.075469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.075627] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-075c59dc-6bd0-43a5-bce4-a241b73113a3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.440961] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: SUCCESS [ 1319.441377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.441377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.441593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.441777] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.441899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.441968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.442190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.442283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.442383] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.605191] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.605363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.605657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.605657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.605753] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.945172] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.108519] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.447060] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.610922] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.949230] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.949483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.949483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.949705] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.949802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.949905] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc is going to be updated. [ 1320.980444] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.980659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.980659] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.980864] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.981018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.989257] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: IN_PROGRESS for 2s [ 1321.113139] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1321.113332] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1321.966905] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.967335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.967335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.967335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.980507] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1321.981395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.982125] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1322.021407] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.021652] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.021652] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.021915] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.033305] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.034150] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1322.034237] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1322.034346] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1322.076845] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.076845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.076845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.076845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.078035] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.078225] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1322.161325] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.161555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.161555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.161775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.162137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.162455] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1322.273904] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.274180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.274180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.274356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.274674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.274989] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1322.275126] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'bbb08221-1c71-4b91-a7dd-598e8bbc7914', '796dade6-def8-42b0-adbd-7347623ab0c8', 'da83f74d-33e1-4838-a0f1-70f509a0a68c', 'ebfca2b7-f089-437e-979a-24f210590561', 'ab7773f0-7815-4a45-bf15-8a8079aa86ff', 'a2757bc9-a946-4a06-ad40-4649502b2e59', 'd7c6f902-1ed1-48d9-b962-db2feb55482d', '9632268c-db1a-4548-9652-b638bc84b886', '6fd20800-5a4b-495c-a02a-35b10f00ea55', '41c677ae-81d2-401f-823f-258d2ebc4afc', 'a17d719d-b50f-4937-8fa1-f7b3109414a1', '64836ebf-8b10-4f23-98d0-28aef1aadca7', '8d5a33a2-cab9-4479-9d1c-125f032b265a', '5e544cb2-f99f-4d89-9314-20a97f2f4942', 'ab8f0b03-5851-4bc3-a9e8-aba2b5714126', '88118802-dd47-4c99-a6fd-7180a306f792', 'bf9b465c-1203-4ee7-a3bb-19ccfc886da5', 'a783226f-a1df-4921-a642-6c211f5f8022', 'c9023993-36fc-47c8-9c97-1eea2e87c7cf', '337bf73b-206c-43a7-940b-8771364a9da6', 'd226f0cc-ed68-4bbb-a45f-f167f2ea29ab', 'eaa139e8-f09f-4a46-897a-d481019a63be', 'e040c3ad-864e-4a08-8074-d3b87c80b2c3', 'f5d9b441-54c3-4ef0-8866-aee0f17f0fb9', '9028d23d-9b03-48da-a060-d720486e9412', '1174b667-c607-4471-b059-900f8b5c4de2', '57178755-8937-4ec8-907c-6e349b3947d2', '556224b2-1959-4315-89ac-879f1d706247', '491f4d82-845e-4e02-b3d7-2b5c77772eb6', '96abde26-4f7d-4753-9d4c-ed85ae0b31bf', '6f1845a9-2c44-4df3-b2c4-babd12fe1f1d', '2718fb34-4e94-4380-bd09-5b025d3b2125', '8c9d4b0f-923e-4454-badc-cbd5c63e211f', 'd394eeb6-7de4-4a71-8d79-c137cc55ad50', '57114c60-305d-46b5-a583-fad2bd258d54', '8c5808a0-5aae-42f0-89ec-a7d1d00bc588', '4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017', '71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f', '0cc2812f-6296-4ced-a800-c6fb38741a8e', 'f1812f0f-128b-41f6-987e-18e589d1ef41', 'c01fe6e7-4574-4c6a-973e-552160230574', '6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd', '745f6209-d9d3-480b-9445-604b9585bfe0', '5f6ef41a-5e03-4f6b-8b59-b1f729f165d1'} {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1322.275246] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1322.307819] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.308064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.308064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.308265] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.308353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.308520] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1322.308588] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1322.308663] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1322.454732] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.454732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.454732] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.454905] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.457015] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.457015] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1322.457015] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1322.457015] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1322.457281] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1322.457281] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1322.457281] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGH for action security_group_rules [ 1322.457392] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGH for action security_group_rules [ 1322.457589] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGH for action security_group_rules [ 1322.457589] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGH for action security_group_rules [ 1322.457589] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGH for action security_group_rules [ 1322.457698] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGH for action security_group_rules [ 1322.457775] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGH for action security_group_rules [ 1322.457775] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGH for action security_group_rules [ 1322.457850] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGH for action security_group_rules [ 1322.457924] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGH for action security_group_rules [ 1322.458024] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 with Priority: HIGH for action security_group_rules [ 1322.458100] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGH for action security_group_rules [ 1322.458185] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGH for action security_group_rules [ 1322.458242] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 with Priority: HIGH for action security_group_rules [ 1322.458309] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGH for action security_group_rules [ 1322.458364] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGH for action security_group_rules [ 1322.458443] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGH for action security_group_rules [ 1322.458539] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGH for action security_group_rules [ 1322.458608] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf with Priority: HIGH for action security_group_rules [ 1322.458669] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 337bf73b-206c-43a7-940b-8771364a9da6 with Priority: HIGH for action security_group_rules [ 1322.458823] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.545609] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.545856] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=2 [ 1322.545856] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 with Priority: HIGH for action security_group_rules [ 1322.546039] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGH for action security_group_rules [ 1322.546106] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c6f902-1ed1-48d9-b962-db2feb55482d with Priority: HIGH for action security_group_rules [ 1322.546193] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 with Priority: HIGH for action security_group_rules [ 1322.546353] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 337bf73b-206c-43a7-940b-8771364a9da6 with Priority: HIGH for action security_group_rules [ 1322.546410] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf with Priority: HIGH for action security_group_rules [ 1322.546553] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a783226f-a1df-4921-a642-6c211f5f8022 with Priority: HIGH for action security_group_rules [ 1322.546615] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGH for action security_group_rules [ 1322.546737] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 with Priority: HIGH for action security_group_rules [ 1322.546812] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88118802-dd47-4c99-a6fd-7180a306f792 with Priority: HIGH for action security_group_rules [ 1322.546884] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a with Priority: HIGH for action security_group_rules [ 1322.546965] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 with Priority: HIGH for action security_group_rules [ 1322.547038] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 with Priority: HIGH for action security_group_rules [ 1322.547127] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGH for action security_group_rules [ 1322.547207] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 with Priority: HIGH for action security_group_rules [ 1322.547280] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2757bc9-a946-4a06-ad40-4649502b2e59 with Priority: HIGH for action security_group_rules [ 1322.547362] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9632268c-db1a-4548-9652-b638bc84b886 with Priority: HIGH for action security_group_rules [ 1322.547448] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff with Priority: HIGH for action security_group_rules [ 1322.547530] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 796dade6-def8-42b0-adbd-7347623ab0c8 with Priority: HIGH for action security_group_rules [ 1322.547607] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfca2b7-f089-437e-979a-24f210590561 with Priority: HIGH for action security_group_rules [ 1322.547972] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.548144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.548208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.548447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.548584] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbb08221-1c71-4b91-a7dd-598e8bbc7914',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.549626] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.549760] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.549820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.550018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.550105] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.550945] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7c6f902-1ed1-48d9-b962-db2feb55482d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.551085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.551156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.551301] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.551377] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7c6f902-1ed1-48d9-b962-db2feb55482d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.552573] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.552706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.552751] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.552895] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.552969] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab8f0b03-5851-4bc3-a9e8-aba2b5714126',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.553665] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-337bf73b-206c-43a7-940b-8771364a9da6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.554028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.554028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.554028] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.554223] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('337bf73b-206c-43a7-940b-8771364a9da6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.555026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9023993-36fc-47c8-9c97-1eea2e87c7cf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.555144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.555213] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.555372] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.555446] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9023993-36fc-47c8-9c97-1eea2e87c7cf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.556149] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a783226f-a1df-4921-a642-6c211f5f8022 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.556262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.556355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.556479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.556554] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a783226f-a1df-4921-a642-6c211f5f8022',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.558666] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.558666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.558666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.558666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.558666] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.558666] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e544cb2-f99f-4d89-9314-20a97f2f4942 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.558666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.558666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.559315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.559315] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e544cb2-f99f-4d89-9314-20a97f2f4942',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.559766] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88118802-dd47-4c99-a6fd-7180a306f792 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.559766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.559766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.559952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.559952] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88118802-dd47-4c99-a6fd-7180a306f792',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.560768] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d5a33a2-cab9-4479-9d1c-125f032b265a taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.560768] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.560877] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.561206] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.561206] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d5a33a2-cab9-4479-9d1c-125f032b265a',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.561868] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64836ebf-8b10-4f23-98d0-28aef1aadca7 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.561968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.561968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.562162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.562202] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64836ebf-8b10-4f23-98d0-28aef1aadca7',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.562897] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a17d719d-b50f-4937-8fa1-f7b3109414a1 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.562973] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.563486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.563486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.563486] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a17d719d-b50f-4937-8fa1-f7b3109414a1',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.563912] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.563997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.564219] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd20800-5a4b-495c-a02a-35b10f00ea55 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.564354] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.564401] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.564637] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.564637] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd20800-5a4b-495c-a02a-35b10f00ea55',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.565537] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2757bc9-a946-4a06-ad40-4649502b2e59 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.565537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.565692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.565752] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.565835] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2757bc9-a946-4a06-ad40-4649502b2e59',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.566511] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9632268c-db1a-4548-9652-b638bc84b886 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.566636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.566712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.566858] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.566929] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9632268c-db1a-4548-9652-b638bc84b886',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.567617] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.567728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.567790] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.567947] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.568031] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab7773f0-7815-4a45-bf15-8a8079aa86ff',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.568724] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-796dade6-def8-42b0-adbd-7347623ab0c8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.568832] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.568894] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.569100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.569171] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('796dade6-def8-42b0-adbd-7347623ab0c8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.569967] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebfca2b7-f089-437e-979a-24f210590561 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.570088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.570155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.570304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.570376] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebfca2b7-f089-437e-979a-24f210590561',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.593794] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.593996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.593996] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.594150] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.623835] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.624021] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7c6f902-1ed1-48d9-b962-db2feb55482d is going to be deleted. [ 1322.679799] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.679990] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.680051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.680303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.680425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.680583] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7c6f902-1ed1-48d9-b962-db2feb55482d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.998958] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: SUCCESS [ 1322.999362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.999362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.999636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.999837] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.999960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.000043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.000209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.000293] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.000382] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.000475] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.075692] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.075923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.075923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.076117] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.076297] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.076429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.076508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.076670] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.076755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.076843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.076930] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.085472] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.085641] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.085706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.085828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.085975] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.086082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.086146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.086317] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.086460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.086460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.086561] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.146084] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.146321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.146321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.146638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.148465] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.148605] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.149317] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.149462] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.150169] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.150271] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.150982] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.151168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.151784] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.151874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.152577] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.152673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.153774] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.153899] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.154560] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.154656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.155356] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.155450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.156199] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.156313] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.157222] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1323.157623] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.157707] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.158309] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1323.158761] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.158852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.167654] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1323.168280] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.168496] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.169220] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1323.169647] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.169769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.171261] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1323.171690] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.171820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.176625] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1323.177102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.177251] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2757bc9-a946-4a06-ad40-4649502b2e59 is going to be deleted. [ 1323.178168] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.178409] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.195626] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.195787] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a783226f-a1df-4921-a642-6c211f5f8022 is going to be deleted. [ 1323.196661] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.196879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.214555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.214742] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab7773f0-7815-4a45-bf15-8a8079aa86ff is going to be deleted. [ 1323.215517] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.215730] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.237441] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.237652] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9023993-36fc-47c8-9c97-1eea2e87c7cf is going to be deleted. [ 1323.238506] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.238717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.243503] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.243614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.259753] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.259970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.271447] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.271605] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.272381] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.272502] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d5a33a2-cab9-4479-9d1c-125f032b265a is going to be deleted. [ 1323.273394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.273795] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.295158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.295351] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 337bf73b-206c-43a7-940b-8771364a9da6 is going to be deleted. [ 1323.296324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.296597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.333960] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.334178] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.350769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.350987] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd20800-5a4b-495c-a02a-35b10f00ea55 is going to be deleted. [ 1323.351910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.352146] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.382697] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.382838] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.397731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.397907] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a17d719d-b50f-4937-8fa1-f7b3109414a1 is going to be deleted. [ 1323.398894] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.399147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.428379] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.428538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.453055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.453202] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88118802-dd47-4c99-a6fd-7180a306f792 is going to be deleted. [ 1323.454132] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.454350] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.497282] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.497529] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.502912] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.537438] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.537615] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebfca2b7-f089-437e-979a-24f210590561 is going to be deleted. [ 1323.538662] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.538952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.566812] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.566969] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab8f0b03-5851-4bc3-a9e8-aba2b5714126 is going to be deleted. [ 1323.567985] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.568076] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.571518] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.571518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.583601] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.590141] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.590408] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.601765] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.612966] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.613155] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64836ebf-8b10-4f23-98d0-28aef1aadca7 is going to be deleted. [ 1323.614647] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.614934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.657065] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.657331] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.662153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.662319] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e544cb2-f99f-4d89-9314-20a97f2f4942 is going to be deleted. [ 1323.663279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.663499] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.689040] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.689040] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.701254] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.701450] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9632268c-db1a-4548-9652-b638bc84b886 is going to be deleted. [ 1323.702425] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.702660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.767784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.767972] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 796dade6-def8-42b0-adbd-7347623ab0c8 is going to be deleted. [ 1323.768962] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.769205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.772447] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.772636] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.800708] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.800928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.809026] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.809239] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.810151] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.810274] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbb08221-1c71-4b91-a7dd-598e8bbc7914 is going to be deleted. [ 1323.811302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.811495] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.811584] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.811649] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2757bc9-a946-4a06-ad40-4649502b2e59" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.811805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.811968] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.812062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.812180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a783226f-a1df-4921-a642-6c211f5f8022" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.812655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.812900] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.813009] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.813093] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab7773f0-7815-4a45-bf15-8a8079aa86ff" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.813233] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.813385] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.813464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.813579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9023993-36fc-47c8-9c97-1eea2e87c7cf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.813710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.813853] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.813929] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.814052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d5a33a2-cab9-4479-9d1c-125f032b265a" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.814181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.814321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.814395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.814505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-337bf73b-206c-43a7-940b-8771364a9da6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.814632] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.814770] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.814844] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.814956] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a17d719d-b50f-4937-8fa1-f7b3109414a1" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.815100] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.815241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.815315] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.815427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd20800-5a4b-495c-a02a-35b10f00ea55" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.815549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.815685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.815758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.815868] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88118802-dd47-4c99-a6fd-7180a306f792" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.815986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.816138] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.816211] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.816321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebfca2b7-f089-437e-979a-24f210590561" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.816475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.816658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.816710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.816780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab8f0b03-5851-4bc3-a9e8-aba2b5714126" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.816903] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.817051] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.817129] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.817235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e544cb2-f99f-4d89-9314-20a97f2f4942" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.817356] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.817494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.817569] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.817710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64836ebf-8b10-4f23-98d0-28aef1aadca7" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.817843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.817986] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.818082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.818189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9632268c-db1a-4548-9652-b638bc84b886" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.939609] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.939865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.939865] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.940062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.940160] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.940279] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbb08221-1c71-4b91-a7dd-598e8bbc7914" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.941057] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.941175] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.941241] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.941409] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.941493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.941609] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-796dade6-def8-42b0-adbd-7347623ab0c8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.005103] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41c677ae-81d2-401f-823f-258d2ebc4afc: rpc.has_security_group_logging(os_id): False [ 1324.058755] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.059018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.059076] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.059302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.085691] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf9b465c-1203-4ee7-a3bb-19ccfc886da5: rpc.has_security_group_logging(os_id): False [ 1324.099749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.100096] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.100235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.100306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.100528] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.100617] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.100711] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc is going to be updated. [ 1324.103983] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da83f74d-33e1-4838-a0f1-70f509a0a68c: rpc.has_security_group_logging(os_id): False [ 1324.118423] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.118646] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.118696] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.118917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.129107] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.129235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.147656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.147981] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.148194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.148194] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.148370] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.148520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.148614] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be updated. [ 1324.149741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.149934] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.184362] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.184643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.191901] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.192319] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.192436] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.192509] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.192718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.192807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.192897] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da83f74d-33e1-4838-a0f1-70f509a0a68c is going to be updated. [ 1324.194018] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.194380] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.194533] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.211865] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: IN_PROGRESS for 2s [ 1324.217875] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.218130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.218264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.218656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.218910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.235049] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: IN_PROGRESS for 2s [ 1324.295847] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.296084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.296084] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.296306] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.296507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.318021] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da83f74d-33e1-4838-a0f1-70f509a0a68c in Status: IN_PROGRESS for 2s [ 1326.225744] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: SUCCESS [ 1326.226125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.226125] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.226393] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.226524] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.247238] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1326.247467] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.331813] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da83f74d-33e1-4838-a0f1-70f509a0a68c in Status: SUCCESS [ 1326.332134] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.729563] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.729563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.729805] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.729927] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.730121] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.730285] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.730360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.730571] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.730657] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.730758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.730928] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.233562] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.548387] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.548534] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1327.736731] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41c677ae-81d2-401f-823f-258d2ebc4afc: rpc.has_security_group_logging(os_id): False [ 1327.754382] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.754538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.754612] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.754837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.754928] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.755192] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.755297] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.755362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.755514] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.755592] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.755682] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc is going to be updated. [ 1327.885041] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.885041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.885041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.885041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.885041] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.898624] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: IN_PROGRESS for 2s [ 1328.139662] env[69491]: INFO networking_nsxv3.common.synchronization [None req-a3ebef56-1ab1-45a2-852a-ac6d89ed8579 tempest-ServerActionsTestJSON-1508696760 tempest-ServerActionsTestJSON-1508696760-project-member] Enqueued Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGHEST for action security_group_rules [ 1328.140186] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGHEST for action security_group_rules [ 1328.140498] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.140629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.140699] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.140987] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.141142] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.208246] env[69491]: INFO networking_nsxv3.common.synchronization [None req-33ae33b9-42c5-4992-a8c8-aea9f615d9a2 tempest-ServerActionsTestJSON-1508696760 tempest-ServerActionsTestJSON-1508696760-project-member] Enqueued Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGHEST for action security_group_rules [ 1328.208801] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGHEST for action security_group_rules [ 1328.209108] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.209217] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.661522] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.661845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.661845] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.661958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.662064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.662158] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 already deleted. [ 1328.662251] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.662429] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.662595] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.662681] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.191482] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.191678] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.191728] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.191916] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.192011] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.192127] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 already deleted. [ 1329.192215] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.914070] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: SUCCESS [ 1329.914443] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.209944] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1333.210345] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1333.510554] env[69491]: INFO networking_nsxv3.common.synchronization [req-389eb3c3-1c55-4d98-b4c9-718bfda9b4d9 req-0ea2c592-f91a-4e2a-a53c-cb7ff3505aa7 tempest-ServerActionsTestJSON-1508696760 tempest-ServerActionsTestJSON-1508696760-project-member] Enqueued Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGHEST for action security_group_members [ 1333.511040] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGHEST for action security_group_members [ 1333.511380] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.511731] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.511875] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.512180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.512367] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.512480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.512538] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.512719] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.512807] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.512903] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.818721] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-698 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.818943] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.819087] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.819369] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.819654] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.819817] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.819944] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.820181] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.820334] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.820550] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1333.820682] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1333.820800] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1333.820918] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1333.821047] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1333.821165] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1333.821302] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1333.841323] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1333.841492] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1333.841643] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1333.841823] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.842159] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.842343] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.842471] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.842826] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.843020] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.015771] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.016017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.016017] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.016237] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.016345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.016566] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.016697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.016772] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.016882] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.016959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.017058] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 already deleted. [ 1334.017170] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.345541] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.345993] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.345993] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.346162] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.346315] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.346495] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01 not found, creating... [ 1334.346758] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.346924] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.347063] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.347297] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.347439] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.347790] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.347992] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.348152] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.348409] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.348601] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.348748] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01 is going to be created. [ 1334.369075] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.369317] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.369418] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.369768] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.370015] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.370260] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.882597] env[69491]: INFO networking_nsxv3.common.synchronization [req-3cfdf6d1-1d08-4316-8588-e605d1e21572 req-af566f0d-fd43-49f4-a74d-a4c29b77d640 tempest-AttachVolumeShelveTestJSON-1615643752 tempest-AttachVolumeShelveTestJSON-1615643752-project-member] Enqueued Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_members [ 1334.883207] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGHEST for action security_group_members [ 1334.883564] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.883788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.883911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.884176] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.884361] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.884483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.884557] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.884758] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.884991] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.884991] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.174053] env[69491]: INFO networking_nsxv3.common.synchronization [req-389eb3c3-1c55-4d98-b4c9-718bfda9b4d9 req-20735208-158e-4435-b20c-5f5b1077181b service nova] Enqueued Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGHEST for action security_group_rules [ 1335.174267] env[69491]: INFO networking_nsxv3.common.synchronization [req-389eb3c3-1c55-4d98-b4c9-718bfda9b4d9 req-20735208-158e-4435-b20c-5f5b1077181b service nova] Enqueued Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGHEST for action security_group_members [ 1335.174413] env[69491]: INFO networking_nsxv3.common.synchronization [req-389eb3c3-1c55-4d98-b4c9-718bfda9b4d9 req-20735208-158e-4435-b20c-5f5b1077181b service nova] Enqueued Resource ID: fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01 with Priority: HIGHEST for action port [ 1335.174680] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGHEST for action security_group_rules [ 1335.174818] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGHEST for action security_group_members [ 1335.174913] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01 with Priority: HIGHEST for action port [ 1335.175577] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.175718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.175787] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.176043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.176091] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.177295] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.177415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.177486] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.177660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.177832] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.177935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.178013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.178240] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.178294] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.178408] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.179784] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.179914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.179914] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.180208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.180313] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.387320] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.387733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.387733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.387860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.387860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.388053] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.388147] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.388208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.388357] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.388433] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.388522] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da83f74d-33e1-4838-a0f1-70f509a0a68c is going to be updated. [ 1335.418770] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.418993] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.418993] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.419210] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.419360] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.428282] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da83f74d-33e1-4838-a0f1-70f509a0a68c in Status: IN_PROGRESS for 2s [ 1335.682514] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.683681] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.683681] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.683793] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01 with status ACTIVE [ 1335.684485] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.684485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.684485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.684485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.684485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.685022] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.685022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.685022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.685022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.685022] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.685322] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.685322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.685322] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.685552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.685552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.685552] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01 is going to be updated. [ 1335.709335] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.709335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.709547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.709798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.709975] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.710173] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc9f31e0-c6b3-4ff2-af1c-891c1ae24a01" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.187925] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.691178] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.691738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.691738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.691738] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.691919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.691919] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 is going to be created. [ 1336.717823] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.718067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.718067] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.718286] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.718457] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.729058] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 in Status: UNINITIALIZED for 2s [ 1337.438024] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da83f74d-33e1-4838-a0f1-70f509a0a68c in Status: SUCCESS [ 1337.438319] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da83f74d-33e1-4838-a0f1-70f509a0a68c deletion is rescheduled due to dependency. [ 1337.438466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.738682] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 in Status: SUCCESS [ 1338.739113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.739113] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.739328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.739523] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.739652] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.739720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.739876] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.739958] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.740060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.740152] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.242657] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.602377] env[69491]: INFO networking_nsxv3.common.synchronization [None req-213f7714-c125-4ff6-85b0-c854947ac335 tempest-AttachVolumeShelveTestJSON-1615643752 tempest-AttachVolumeShelveTestJSON-1615643752-project-member] Enqueued Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_rules [ 1339.602920] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_rules [ 1339.603243] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86024434-1c7d-4212-8500-b6ef6ea57af9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.603377] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.603505] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.603710] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.603796] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.673815] env[69491]: INFO networking_nsxv3.common.synchronization [None req-f6280a13-dab6-4d6a-8e20-b17268624bd6 tempest-AttachVolumeShelveTestJSON-1615643752 tempest-AttachVolumeShelveTestJSON-1615643752-project-member] Enqueued Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_rules [ 1339.674431] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_rules [ 1339.674660] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86024434-1c7d-4212-8500-b6ef6ea57af9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.674778] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.746903] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2: rpc.has_security_group_logging(os_id): False [ 1339.770990] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.771197] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.771245] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.771449] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.771539] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.771802] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.771923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.772010] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.772292] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.772379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.772471] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 is going to be created. [ 1339.847052] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.847366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.847366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.847510] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.847568] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.858232] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 in Status: IN_PROGRESS for 2s [ 1340.126029] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.126267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.126267] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.126468] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.126588] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.126690] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 already deleted. [ 1340.126781] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.126961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.127171] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.127256] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.647209] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.647415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.647415] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.647589] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.647680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.647780] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 already deleted. [ 1340.647866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.870518] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 in Status: SUCCESS [ 1341.870518] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.675392] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1344.675801] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.067697] env[69491]: INFO networking_nsxv3.common.synchronization [req-f058e47a-b413-4f44-8256-6814b2805067 req-70b628a4-cb1c-48fb-b71a-8eafdb9a4631 tempest-AttachVolumeShelveTestJSON-1615643752 tempest-AttachVolumeShelveTestJSON-1615643752-project-member] Enqueued Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_members [ 1345.068396] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_members [ 1345.068848] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-86024434-1c7d-4212-8500-b6ef6ea57af9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.068997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.069072] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.069318] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.069474] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.069584] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.069808] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.070026] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.070155] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.070445] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.345671] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.345880] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.346016] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.346303] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.346568] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.346756] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.346892] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.347137] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.347292] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.347517] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1345.347634] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1345.347752] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1345.347871] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1345.347987] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1345.348120] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1345.348262] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1345.369500] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1345.369710] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1345.369823] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1345.370020] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.370362] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-44e0a80f-11d1-4b19-8cec-b1592440fa68 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.370545] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.370673] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.371032] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.371194] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44e0a80f-11d1-4b19-8cec-b1592440fa68',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.572861] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.573157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.573157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.573406] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.573501] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.573819] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.573921] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.573992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.574148] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.574296] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.574397] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 already deleted. [ 1345.574485] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.873849] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.874117] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.874247] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.874534] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.874692] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.874855] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 44e0a80f-11d1-4b19-8cec-b1592440fa68 not found, creating... [ 1345.875128] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.875296] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.875421] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.875653] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.875798] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.876112] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.876281] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.876406] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.876650] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.876807] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.876955] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 44e0a80f-11d1-4b19-8cec-b1592440fa68 is going to be created. [ 1345.897535] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.897760] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.897898] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.898275] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.898521] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.898818] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.576338] env[69491]: INFO networking_nsxv3.common.synchronization [req-f058e47a-b413-4f44-8256-6814b2805067 req-fe5b14a3-647b-4ccd-896d-cdc632961854 service nova] Enqueued Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_rules [ 1346.576520] env[69491]: INFO networking_nsxv3.common.synchronization [req-f058e47a-b413-4f44-8256-6814b2805067 req-fe5b14a3-647b-4ccd-896d-cdc632961854 service nova] Enqueued Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_members [ 1346.576700] env[69491]: INFO networking_nsxv3.common.synchronization [req-f058e47a-b413-4f44-8256-6814b2805067 req-fe5b14a3-647b-4ccd-896d-cdc632961854 service nova] Enqueued Resource ID: 44e0a80f-11d1-4b19-8cec-b1592440fa68 with Priority: HIGHEST for action port [ 1346.577326] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_rules [ 1346.577529] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_members [ 1346.577667] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44e0a80f-11d1-4b19-8cec-b1592440fa68 with Priority: HIGHEST for action port [ 1346.577998] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86024434-1c7d-4212-8500-b6ef6ea57af9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.578181] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.578282] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.578523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.579405] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.580353] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-86024434-1c7d-4212-8500-b6ef6ea57af9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.580472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.580540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.580722] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.580915] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.581047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.581122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.581278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.581366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.581459] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.582229] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-44e0a80f-11d1-4b19-8cec-b1592440fa68 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.582545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.582545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.582545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.582670] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44e0a80f-11d1-4b19-8cec-b1592440fa68',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.084347] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-86024434-1c7d-4212-8500-b6ef6ea57af9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.084347] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.084818] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44e0a80f-11d1-4b19-8cec-b1592440fa68 with status ACTIVE [ 1347.084818] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.085024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.085024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.085198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.085261] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.085440] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.085530] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.085590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.085735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.085808] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.086011] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.086107] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.086167] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.086303] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.086374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.086458] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44e0a80f-11d1-4b19-8cec-b1592440fa68 is going to be updated. [ 1347.087524] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.109064] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.109064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.109064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.109064] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.109427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.109427] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.589991] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.093102] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.093102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.093102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.093102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.093102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.093102] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 is going to be created. [ 1348.117062] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.117062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.117062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.117062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.117062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.126813] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 in Status: UNINITIALIZED for 2s [ 1350.137711] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 in Status: SUCCESS [ 1350.138124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.138124] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.138308] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.138503] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.138619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.138688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.138880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.138956] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.139055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.139147] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.641999] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.146112] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86024434-1c7d-4212-8500-b6ef6ea57af9: rpc.has_security_group_logging(os_id): False [ 1351.164439] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.164674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.164674] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.164866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.164972] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.165253] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.165361] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.165423] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.165593] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.166043] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.166043] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 is going to be created. [ 1351.226289] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.226534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.226534] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.226722] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.226919] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.237841] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 in Status: IN_PROGRESS for 2s [ 1351.579024] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.579259] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1353.251033] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 in Status: SUCCESS [ 1353.251466] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.580927] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.581387] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.581595] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.582027] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.583485] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.583868] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.585387] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.585641] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.587040] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.587040] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.588521] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.588521] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.834736] env[69491]: INFO networking_nsxv3.common.synchronization [req-522d9146-ee4c-4ff8-a9d0-402bbd99e365 req-ee52cda3-1e82-494e-93ee-3d8cf3114112 tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_members [ 1381.834987] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_members [ 1381.835667] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.835667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.835667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.835804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.835903] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.835997] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.836673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.836673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.836673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.836673] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.339164] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.841646] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.343660] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.343859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.343859] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.344130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.344221] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.344325] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc is going to be updated. [ 1383.374929] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.375177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.375177] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.375366] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.375511] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.384878] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: IN_PROGRESS for 2s [ 1385.396190] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: SUCCESS [ 1385.396549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.835871] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.836222] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.837190] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.837456] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1396.838420] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.838715] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.013577] env[69491]: INFO networking_nsxv3.common.synchronization [req-addb2df7-90d3-4f7d-99c4-4635dee644e9 req-633f7042-4dad-44ca-a160-6eff1b6252ab tempest-ServerActionsTestOtherA-1239666620 tempest-ServerActionsTestOtherA-1239666620-project-member] Enqueued Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_members [ 1397.014121] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c677ae-81d2-401f-823f-258d2ebc4afc with Priority: HIGHEST for action security_group_members [ 1397.014468] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-41c677ae-81d2-401f-823f-258d2ebc4afc taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.014597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.014669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.014959] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.015765] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.015765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.015765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.015765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.015765] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.015765] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41c677ae-81d2-401f-823f-258d2ebc4afc',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.519061] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.519061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.519061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.519061] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.519343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.519462] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.519587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.519673] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.519904] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.520023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.520172] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc is going to be updated. [ 1397.552995] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.553249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.553249] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.553437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.553590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.565584] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: IN_PROGRESS for 2s [ 1399.576330] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41c677ae-81d2-401f-823f-258d2ebc4afc in Status: SUCCESS [ 1399.577830] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41c677ae-81d2-401f-823f-258d2ebc4afc deletion is rescheduled due to dependency. [ 1399.577830] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41c677ae-81d2-401f-823f-258d2ebc4afc" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.015421] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.015769] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.017235] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.017618] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.018805] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.019190] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1417.020215] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.020620] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.498701] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.498994] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.499050] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.499339] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.499606] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.499771] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.499926] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.500233] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.500394] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.500614] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1418.500736] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1418.500877] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1418.501044] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1418.501182] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1418.501301] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1418.501445] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1418.521878] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1418.522020] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1418.522163] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1418.522342] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-61" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.522661] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-44e0a80f-11d1-4b19-8cec-b1592440fa68 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.522837] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.522968] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.523264] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.523409] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44e0a80f-11d1-4b19-8cec-b1592440fa68',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.026106] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.026420] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.026599] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.026934] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.027146] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.027479] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.027669] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.027866] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.028083] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.028240] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.028531] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.028694] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.028821] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.029078] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.029233] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.029387] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 44e0a80f-11d1-4b19-8cec-b1592440fa68 is going to be updated. [ 1419.051165] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.051375] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.051505] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.051777] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.051981] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.052225] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.718265] env[69491]: INFO networking_nsxv3.common.synchronization [req-348cc3a0-0647-467e-bfdd-12cb48f58588 req-c78ce872-ddad-42f9-b19e-d0e7e87cf89d service nova] Enqueued Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_rules [ 1419.718507] env[69491]: INFO networking_nsxv3.common.synchronization [req-348cc3a0-0647-467e-bfdd-12cb48f58588 req-c78ce872-ddad-42f9-b19e-d0e7e87cf89d service nova] Enqueued Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_members [ 1419.718543] env[69491]: INFO networking_nsxv3.common.synchronization [req-348cc3a0-0647-467e-bfdd-12cb48f58588 req-c78ce872-ddad-42f9-b19e-d0e7e87cf89d service nova] Enqueued Resource ID: 44e0a80f-11d1-4b19-8cec-b1592440fa68 with Priority: HIGHEST for action port [ 1419.718751] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_rules [ 1419.718888] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_members [ 1419.718988] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44e0a80f-11d1-4b19-8cec-b1592440fa68 with Priority: HIGHEST for action port [ 1419.719546] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86024434-1c7d-4212-8500-b6ef6ea57af9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.719676] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.719746] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.719979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.720195] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.721247] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-86024434-1c7d-4212-8500-b6ef6ea57af9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.721247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.721519] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.721706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.721859] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.721953] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.722075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.722176] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.722263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.722356] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.723628] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-44e0a80f-11d1-4b19-8cec-b1592440fa68 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.723801] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.723874] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.724046] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.724126] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44e0a80f-11d1-4b19-8cec-b1592440fa68',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.228320] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44e0a80f-11d1-4b19-8cec-b1592440fa68 with status ACTIVE [ 1420.228320] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.228320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.228320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.228320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.228320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.228320] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.228320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.228320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.228320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.228320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.228320] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.228320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.228871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.228871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.228871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.228871] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44e0a80f-11d1-4b19-8cec-b1592440fa68 is going to be updated. [ 1420.229803] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.232218] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-86024434-1c7d-4212-8500-b6ef6ea57af9 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.232334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.253088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.253309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.253309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.253523] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.253658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.253883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44e0a80f-11d1-4b19-8cec-b1592440fa68" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.733477] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.236477] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.236686] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.236733] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.237057] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.237189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.237340] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 is going to be updated. [ 1421.268546] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.268792] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.268867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.269478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.269478] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.273508] env[69491]: INFO networking_nsxv3.common.synchronization [req-19bc6273-e5c2-43c5-a116-b3997713054a req-eacb4e17-2689-4258-b0b9-f542d980a083 tempest-ServerActionsTestJSON-1508696760 tempest-ServerActionsTestJSON-1508696760-project-member] Enqueued Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGHEST for action security_group_members [ 1421.274281] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGHEST for action security_group_members [ 1421.274707] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.274873] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.274972] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.275262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.275478] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.275621] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.275718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.275931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.276073] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.276212] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.281332] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 in Status: IN_PROGRESS for 2s [ 1421.778798] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.779204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.779204] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.779384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.779543] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.779822] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.779980] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.780092] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.780323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.780450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.780556] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 is going to be updated. [ 1421.807984] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.808180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.808180] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.808358] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.808499] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.818933] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 in Status: IN_PROGRESS for 2s [ 1423.291592] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 in Status: SUCCESS [ 1423.291969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.291969] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.292337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.292532] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.292654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.292721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.292880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.292964] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.293068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.293165] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.795558] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.828855] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 in Status: SUCCESS [ 1423.829077] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 deletion is rescheduled due to dependency. [ 1423.829218] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.299059] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86024434-1c7d-4212-8500-b6ef6ea57af9: rpc.has_security_group_logging(os_id): False [ 1424.318298] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.318472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.318638] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.318871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.318961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.319266] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.319422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.319480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.319640] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.319720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.319811] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 is going to be updated. [ 1424.379130] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.379413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.379413] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.379680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.379890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.393508] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 in Status: IN_PROGRESS for 2s [ 1426.275801] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.276217] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1426.408674] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 in Status: SUCCESS [ 1426.408857] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.277153] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.277566] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.278362] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.278694] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1441.279838] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.280247] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.281506] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.281790] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.282478] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.282841] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.415592] env[69491]: INFO networking_nsxv3.common.synchronization [req-55f00b6a-56b0-42a8-86de-1208cc0f5603 req-c8bd7860-84ec-4931-b81e-f491741af7d2 tempest-ServerActionsTestJSON-1508696760 tempest-ServerActionsTestJSON-1508696760-project-member] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1453.415995] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1453.416634] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.416766] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.417441] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.417441] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.417441] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.417642] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.417642] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.418077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.418077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.418077] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.920088] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.920273] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.920312] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.920581] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.920687] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.920904] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.921013] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.921082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.921247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.921340] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.921442] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be updated. [ 1453.949313] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.949491] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.949590] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.949806] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.949952] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.959071] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: IN_PROGRESS for 2s [ 1455.970367] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1455.970741] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 deletion is rescheduled due to dependency. [ 1455.970741] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.416776] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.417254] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.326434] env[69491]: INFO networking_nsxv3.common.synchronization [req-dcf0b951-9db9-448c-a25a-fd26666a54fe req-068426ce-84ef-45c2-a97e-29d7df376d04 tempest-ServerActionsTestJSON-1508696760 tempest-ServerActionsTestJSON-1508696760-project-member] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1460.326979] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1460.327311] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.327437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.327507] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.327724] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.327881] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.327979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.328037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.328234] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.328361] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.328480] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.593626] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-698 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.593952] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.594148] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.594492] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.594817] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.595035] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.595217] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.595485] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.595651] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.595896] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1460.596031] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1460.596150] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1460.596268] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1460.596386] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1460.596497] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1460.596677] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1460.619468] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1460.619663] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1460.619790] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1460.619959] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.620320] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-568ff806-bd27-467d-b94c-cbfe12e5fb3f taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.620505] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-568ff806-bd27-467d-b94c-cbfe12e5fb3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.620694] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-568ff806-bd27-467d-b94c-cbfe12e5fb3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.621057] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-568ff806-bd27-467d-b94c-cbfe12e5fb3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.621216] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('568ff806-bd27-467d-b94c-cbfe12e5fb3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.831072] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.831247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.831247] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.831475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.831563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.831776] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.831880] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.831940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.832108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.832189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.832278] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be updated. [ 1460.860951] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.861192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.861192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.861419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.861524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.870612] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: IN_PROGRESS for 2s [ 1461.123631] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.123848] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.123979] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.124306] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.124496] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.124629] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 568ff806-bd27-467d-b94c-cbfe12e5fb3f not found, creating... [ 1461.124901] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.125083] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.125279] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.125451] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.125587] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.125877] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.126057] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.126183] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.126402] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.126543] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.126688] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 568ff806-bd27-467d-b94c-cbfe12e5fb3f is going to be created. [ 1461.148171] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.148406] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.148567] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.148883] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.149139] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.149372] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-568ff806-bd27-467d-b94c-cbfe12e5fb3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.820405] env[69491]: INFO networking_nsxv3.common.synchronization [req-dcf0b951-9db9-448c-a25a-fd26666a54fe req-838f235d-bb4c-4ebb-8124-37fba1f66e38 service nova] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_rules [ 1461.820705] env[69491]: INFO networking_nsxv3.common.synchronization [req-dcf0b951-9db9-448c-a25a-fd26666a54fe req-838f235d-bb4c-4ebb-8124-37fba1f66e38 service nova] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1461.820761] env[69491]: INFO networking_nsxv3.common.synchronization [req-dcf0b951-9db9-448c-a25a-fd26666a54fe req-838f235d-bb4c-4ebb-8124-37fba1f66e38 service nova] Enqueued Resource ID: 568ff806-bd27-467d-b94c-cbfe12e5fb3f with Priority: HIGHEST for action port [ 1461.820986] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_rules [ 1461.821132] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1461.821233] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568ff806-bd27-467d-b94c-cbfe12e5fb3f with Priority: HIGHEST for action port [ 1461.821813] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.821945] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.822165] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.822395] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.822481] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.823476] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.823576] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.823824] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-568ff806-bd27-467d-b94c-cbfe12e5fb3f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.823950] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-568ff806-bd27-467d-b94c-cbfe12e5fb3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.824027] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-568ff806-bd27-467d-b94c-cbfe12e5fb3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.824198] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-568ff806-bd27-467d-b94c-cbfe12e5fb3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.824274] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('568ff806-bd27-467d-b94c-cbfe12e5fb3f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.326060] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.326262] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.326422] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 568ff806-bd27-467d-b94c-cbfe12e5fb3f with status ACTIVE [ 1462.326645] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.326755] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.326852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.327196] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.327325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.327553] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.327688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.327775] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.328038] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.328130] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.328325] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.328444] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.328487] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.328625] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.328702] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.328771] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 568ff806-bd27-467d-b94c-cbfe12e5fb3f is going to be updated. [ 1462.351568] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.351816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.351816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.352037] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.352187] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.352345] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-568ff806-bd27-467d-b94c-cbfe12e5fb3f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.880791] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1462.880791] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 deletion is rescheduled due to dependency. [ 1462.881120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.881120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.881804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.881804] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.881804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.881804] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.881992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.881992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.882062] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.384104] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.886230] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.389100] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.389274] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.389334] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.390092] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.390092] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.390092] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be updated. [ 1464.422040] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.422205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.422275] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.422484] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.422668] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.432279] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: IN_PROGRESS for 2s [ 1466.442981] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1466.443355] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.443464] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.443685] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.443877] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.444010] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.444083] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.444243] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.444323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.444407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.444499] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.821981] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.822166] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1466.947087] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.449130] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf9b465c-1203-4ee7-a3bb-19ccfc886da5: rpc.has_security_group_logging(os_id): False [ 1467.466241] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.466474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.466474] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.466651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.466742] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.466980] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.467102] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.467166] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.467320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.467396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.467483] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be updated. [ 1467.522682] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.522888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.522888] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.523162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.523368] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.535255] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: IN_PROGRESS for 2s [ 1469.548765] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1469.549143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.310354] env[69491]: INFO networking_nsxv3.common.synchronization [req-139f0d1a-e89a-49b5-b92c-7bac2dc4d367 req-3af11464-76ab-44e0-901e-786f21c882a8 tempest-AttachVolumeShelveTestJSON-1615643752 tempest-AttachVolumeShelveTestJSON-1615643752-project-member] Enqueued Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_members [ 1471.310957] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGHEST for action security_group_members [ 1471.311290] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-86024434-1c7d-4212-8500-b6ef6ea57af9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.311428] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.311510] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.311680] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.311835] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.311931] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.312030] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.312201] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.312288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.312384] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1471.815169] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.815383] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.815463] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.816095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.816095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.816095] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.816095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.816095] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.816323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.816481] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.816481] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 is going to be updated. [ 1471.844735] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.845078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.845078] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.845266] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.845397] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.854248] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 in Status: IN_PROGRESS for 2s [ 1473.865293] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 in Status: SUCCESS [ 1473.865683] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 deletion is rescheduled due to dependency. [ 1473.865683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.312132] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.312515] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.313112] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.313483] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.314425] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.314811] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1491.315552] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1491.315954] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.317072] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.317441] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.318528] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1501.318924] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1506.319966] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1506.320407] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1511.321359] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1511.321643] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1516.322830] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1516.323224] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1521.324199] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1521.324617] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1526.325303] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1526.325671] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1531.326225] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1531.326648] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1533.671399] env[69491]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1533.671797] env[69491]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-221d0e0f-d856-44b8-b375-241e0e310871 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1536.327746] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1536.328178] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1541.328961] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1541.330253] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1541.393854] env[69491]: INFO networking_nsxv3.common.synchronization [req-86d825ac-522e-48f9-81c0-9ec83cc018cc req-d0e18271-0849-41f0-8e0f-b92443586c4b tempest-ServerActionsTestJSON-1508696760 tempest-ServerActionsTestJSON-1508696760-project-member] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1541.394415] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1541.394744] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.395264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.395343] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.395549] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.395710] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.395818] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.395878] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.396042] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.396139] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.396230] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.900117] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.900321] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.900393] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.900717] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.900885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.901117] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.901224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.901309] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.901480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.901563] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.901666] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be updated. [ 1541.937849] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.938052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.938052] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.938272] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.938418] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.946458] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: IN_PROGRESS for 2s [ 1543.957946] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1543.958379] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 deletion is rescheduled due to dependency. [ 1543.958379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.395559] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1546.395844] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1550.962591] env[69491]: INFO networking_nsxv3.common.synchronization [req-1b3a377d-0917-49d9-95cf-eaf8ec7609e2 req-f4438601-6b9b-4053-898a-4e97b6e4e173 tempest-ServerActionsTestJSON-1508696760 tempest-ServerActionsTestJSON-1508696760-project-member] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1550.963190] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1550.963556] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.963619] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.963667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.963866] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.964025] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.964122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.964183] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.964325] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.964407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.964494] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.234313] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock network-698 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.234514] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.234646] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.234922] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.235215] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.235381] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.235505] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.235733] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.235882] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.236129] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1551.236253] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] NeedRegenerationException {{(pid=69491) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1551.236366] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] no value, waiting for create lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1551.236480] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] value creation lock acquired {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1551.236594] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] No value present for key: 'zone-id' {{(pid=69491) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1551.236705] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Calling creation function for not-yet-present value {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1551.236843] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1551.270423] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1551.270666] env[69491]: DEBUG dogpile.cache.region [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69491) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1551.270749] env[69491]: DEBUG dogpile.lock [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Released creation lock {{(pid=69491) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1551.270925] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "network-698" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.271285] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock port-7cdc180b-0ff6-494f-a806-80b5dd60a2e8 taken with stack trace [, , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.271468] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "port-7cdc180b-0ff6-494f-a806-80b5dd60a2e8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.271591] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "port-7cdc180b-0ff6-494f-a806-80b5dd60a2e8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.271942] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "port-7cdc180b-0ff6-494f-a806-80b5dd60a2e8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.272103] env[69491]: DEBUG networking_nsxv3.api.rpc [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cdc180b-0ff6-494f-a806-80b5dd60a2e8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.466474] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.466660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.466660] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.466860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.466955] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.467175] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.467278] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.467339] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.467492] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.467567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.467654] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be updated. [ 1551.493116] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.493304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.493304] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.493541] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.493656] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.501807] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: IN_PROGRESS for 2s [ 1551.774992] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.775292] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.775432] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.775738] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.775887] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.776098] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Segment Port 7cdc180b-0ff6-494f-a806-80b5dd60a2e8 not found, creating... [ 1551.776384] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.777019] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.777019] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.777019] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.777161] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.777333] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.777500] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.777969] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.777969] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.777969] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.778166] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Resource: SegmentPort with ID: 7cdc180b-0ff6-494f-a806-80b5dd60a2e8 is going to be created. [ 1551.798593] env[69491]: DEBUG networking_nsxv3.common.locking [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.798819] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.798954] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.799253] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.799564] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.799701] env[69491]: DEBUG oslo_concurrency.lockutils [None req-fc92091d-b2ab-4344-b5d1-2e72a87ed2a4 None None] Releasing lock "port-7cdc180b-0ff6-494f-a806-80b5dd60a2e8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.464563] env[69491]: INFO networking_nsxv3.common.synchronization [req-1b3a377d-0917-49d9-95cf-eaf8ec7609e2 req-3a45d640-c6ed-4bf2-9be9-0477d7bf725d service nova] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_rules [ 1552.464830] env[69491]: INFO networking_nsxv3.common.synchronization [req-1b3a377d-0917-49d9-95cf-eaf8ec7609e2 req-3a45d640-c6ed-4bf2-9be9-0477d7bf725d service nova] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1552.464912] env[69491]: INFO networking_nsxv3.common.synchronization [req-1b3a377d-0917-49d9-95cf-eaf8ec7609e2 req-3a45d640-c6ed-4bf2-9be9-0477d7bf725d service nova] Enqueued Resource ID: 7cdc180b-0ff6-494f-a806-80b5dd60a2e8 with Priority: HIGHEST for action port [ 1552.465412] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_rules [ 1552.465548] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1552.465649] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdc180b-0ff6-494f-a806-80b5dd60a2e8 with Priority: HIGHEST for action port [ 1552.465931] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.466066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.466136] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.466336] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.466453] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.467234] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.467331] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.467519] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cdc180b-0ff6-494f-a806-80b5dd60a2e8 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.467654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cdc180b-0ff6-494f-a806-80b5dd60a2e8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.467689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cdc180b-0ff6-494f-a806-80b5dd60a2e8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.467834] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cdc180b-0ff6-494f-a806-80b5dd60a2e8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.467909] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cdc180b-0ff6-494f-a806-80b5dd60a2e8',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.969620] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.969819] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.969946] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cdc180b-0ff6-494f-a806-80b5dd60a2e8 with status ACTIVE [ 1552.970149] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.970258] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.970324] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.970545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.970633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.970861] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.970977] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.971047] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.971190] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.971283] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.971447] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.971540] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.971596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.971735] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.971814] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.971879] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cdc180b-0ff6-494f-a806-80b5dd60a2e8 is going to be updated. [ 1552.992059] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.992059] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.992257] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.992374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.992450] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.992611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cdc180b-0ff6-494f-a806-80b5dd60a2e8" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.510914] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1553.511208] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 deletion is rescheduled due to dependency. [ 1553.511362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.511911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.512185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.512412] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.512522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.513145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.513145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.513145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.513145] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1554.014784] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1554.516842] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1555.019243] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.019469] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1555.019573] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1555.019860] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1555.019960] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1555.020102] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be updated. [ 1555.048556] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.048749] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1555.048793] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1555.048979] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1555.049145] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1555.057743] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: IN_PROGRESS for 2s [ 1557.069110] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1557.069110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.069110] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.069526] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.069526] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.069629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.069692] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.069871] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.069954] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.070060] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.070153] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1557.467060] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.467060] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1557.572485] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1558.074598] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf9b465c-1203-4ee7-a3bb-19ccfc886da5: rpc.has_security_group_logging(os_id): False [ 1558.091643] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.091883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.091883] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.092066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.092140] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.092391] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.092489] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.092552] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.092701] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.092769] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.092856] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be updated. [ 1558.147441] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.147706] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.147815] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.148229] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.148394] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.162855] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: IN_PROGRESS for 2s [ 1559.609974] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.610437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.610437] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.610612] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.610612] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.112731] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.185917] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1560.186159] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.614695] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.117204] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1561.117348] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1561.890658] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.891077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.891077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.891077] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.903764] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1561.904629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.905621] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1561.953595] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.953820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.953820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.954080] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.965192] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.966048] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1561.966154] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1561.966259] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1561.999274] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.999422] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.999520] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.999675] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.000479] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.000636] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1562.075717] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.075992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.075992] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.076157] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.076482] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.076912] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1562.145574] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.145842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.145842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.145946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.146248] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.146525] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:29. [ 1562.146617] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'bf9b465c-1203-4ee7-a3bb-19ccfc886da5', 'da83f74d-33e1-4838-a0f1-70f509a0a68c', 'd226f0cc-ed68-4bbb-a45f-f167f2ea29ab', 'eaa139e8-f09f-4a46-897a-d481019a63be', 'e040c3ad-864e-4a08-8074-d3b87c80b2c3', 'f5d9b441-54c3-4ef0-8866-aee0f17f0fb9', '9028d23d-9b03-48da-a060-d720486e9412', '1174b667-c607-4471-b059-900f8b5c4de2', '86024434-1c7d-4212-8500-b6ef6ea57af9', '57178755-8937-4ec8-907c-6e349b3947d2', '556224b2-1959-4315-89ac-879f1d706247', '8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2', '491f4d82-845e-4e02-b3d7-2b5c77772eb6', '96abde26-4f7d-4753-9d4c-ed85ae0b31bf', '6f1845a9-2c44-4df3-b2c4-babd12fe1f1d', '2718fb34-4e94-4380-bd09-5b025d3b2125', '8c9d4b0f-923e-4454-badc-cbd5c63e211f', 'd394eeb6-7de4-4a71-8d79-c137cc55ad50', '57114c60-305d-46b5-a583-fad2bd258d54', '8c5808a0-5aae-42f0-89ec-a7d1d00bc588', '4370c0d4-c2c8-4812-bb3f-c5ffc7e8e017', '71cddc03-bf74-4bcd-b9c3-cc77a75ecc3f', '0cc2812f-6296-4ced-a800-c6fb38741a8e', 'f1812f0f-128b-41f6-987e-18e589d1ef41', '41c677ae-81d2-401f-823f-258d2ebc4afc', 'c01fe6e7-4574-4c6a-973e-552160230574', '6e0b9ac4-8645-4917-9a65-04f2c9f2dbfd', '745f6209-d9d3-480b-9445-604b9585bfe0', '5f6ef41a-5e03-4f6b-8b59-b1f729f165d1'} {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1562.146691] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1562.164698] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.164896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.164896] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.165115] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.165207] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.165322] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1562.165401] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1562.165453] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1562.239653] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.239852] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.239890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.240142] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.241419] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.241693] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1562.241769] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69491) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1562.241851] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1562.241943] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1562.242046] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/29 resources of Type:Security Group Rules [ 1562.242133] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGH for action security_group_rules [ 1562.242213] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGH for action security_group_rules [ 1562.242281] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGH for action security_group_rules [ 1562.242343] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGH for action security_group_rules [ 1562.242407] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGH for action security_group_rules [ 1562.242460] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGH for action security_group_rules [ 1562.242523] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGH for action security_group_rules [ 1562.242581] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1174b667-c607-4471-b059-900f8b5c4de2 with Priority: HIGH for action security_group_rules [ 1562.242641] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGH for action security_group_rules [ 1562.242701] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGH for action security_group_rules [ 1562.242763] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGH for action security_group_rules [ 1562.242822] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGH for action security_group_rules [ 1562.242884] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGH for action security_group_rules [ 1562.242958] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGH for action security_group_rules [ 1562.243090] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGH for action security_group_rules [ 1562.243166] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGH for action security_group_rules [ 1562.243213] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGH for action security_group_rules [ 1562.243279] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGH for action security_group_rules [ 1562.243333] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGH for action security_group_rules [ 1562.243398] env[69491]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGH for action security_group_rules [ 1562.243493] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.468343] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1562.468501] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1562.468557] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGH for action security_group_rules [ 1562.468660] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab with Priority: HIGH for action security_group_rules [ 1562.468762] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9028d23d-9b03-48da-a060-d720486e9412 with Priority: HIGH for action security_group_rules [ 1562.468860] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d with Priority: HIGH for action security_group_rules [ 1562.468955] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 with Priority: HIGH for action security_group_rules [ 1562.469065] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57114c60-305d-46b5-a583-fad2bd258d54 with Priority: HIGH for action security_group_rules [ 1562.469163] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 with Priority: HIGH for action security_group_rules [ 1562.469252] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f with Priority: HIGH for action security_group_rules [ 1562.469342] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf with Priority: HIGH for action security_group_rules [ 1562.469431] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 with Priority: HIGH for action security_group_rules [ 1562.469519] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 with Priority: HIGH for action security_group_rules [ 1562.469605] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 with Priority: HIGH for action security_group_rules [ 1562.469693] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 556224b2-1959-4315-89ac-879f1d706247 with Priority: HIGH for action security_group_rules [ 1562.469779] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57178755-8937-4ec8-907c-6e349b3947d2 with Priority: HIGH for action security_group_rules [ 1562.469865] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 with Priority: HIGH for action security_group_rules [ 1562.469948] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 with Priority: HIGH for action security_group_rules [ 1562.470046] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1174b667-c607-4471-b059-900f8b5c4de2 with Priority: HIGH for action security_group_rules [ 1562.470138] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 with Priority: HIGH for action security_group_rules [ 1562.470222] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da83f74d-33e1-4838-a0f1-70f509a0a68c with Priority: HIGH for action security_group_rules [ 1562.470308] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa139e8-f09f-4a46-897a-d481019a63be with Priority: HIGH for action security_group_rules [ 1562.470672] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.470802] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.470867] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.471150] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.471241] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.472339] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.472472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.472472] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.472604] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.472678] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d226f0cc-ed68-4bbb-a45f-f167f2ea29ab',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.473506] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9028d23d-9b03-48da-a060-d720486e9412 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.473608] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.473682] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.473816] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.473888] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9028d23d-9b03-48da-a060-d720486e9412',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.475125] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.475230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.475302] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.475454] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.475522] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f1845a9-2c44-4df3-b2c4-babd12fe1f1d',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.476893] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.476893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.476893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.476893] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.476893] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c5808a0-5aae-42f0-89ec-a7d1d00bc588',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.477270] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57114c60-305d-46b5-a583-fad2bd258d54 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.477353] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.477658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.477658] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.477658] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57114c60-305d-46b5-a583-fad2bd258d54',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.478353] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.478459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.478459] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.478614] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.478746] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d394eeb6-7de4-4a71-8d79-c137cc55ad50',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.479475] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.479560] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.479628] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.479780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.479875] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c9d4b0f-923e-4454-badc-cbd5c63e211f',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.480593] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.480651] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.480683] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.480836] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.480906] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96abde26-4f7d-4753-9d4c-ed85ae0b31bf',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.481594] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2718fb34-4e94-4380-bd09-5b025d3b2125 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.481700] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.481767] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.482055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.482055] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2718fb34-4e94-4380-bd09-5b025d3b2125',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.482655] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.482761] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.482828] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.482974] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.483080] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('491f4d82-845e-4e02-b3d7-2b5c77772eb6',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.483830] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.483940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.484053] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.484202] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.484276] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.484934] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-556224b2-1959-4315-89ac-879f1d706247 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.485056] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.485137] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.485270] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.485344] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('556224b2-1959-4315-89ac-879f1d706247',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.485998] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57178755-8937-4ec8-907c-6e349b3947d2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.486120] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.486188] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.486337] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.486411] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57178755-8937-4ec8-907c-6e349b3947d2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.488501] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86024434-1c7d-4212-8500-b6ef6ea57af9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.488633] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.488669] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.488837] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.488911] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86024434-1c7d-4212-8500-b6ef6ea57af9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.489587] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.489697] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.489763] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.489911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.489983] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5d9b441-54c3-4ef0-8866-aee0f17f0fb9',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.490739] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1174b667-c607-4471-b059-900f8b5c4de2 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.490850] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.490918] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.491079] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.491173] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1174b667-c607-4471-b059-900f8b5c4de2',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.491802] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.491908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.491976] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.492206] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.492206] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e040c3ad-864e-4a08-8074-d3b87c80b2c3',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.492941] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da83f74d-33e1-4838-a0f1-70f509a0a68c taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.493082] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.493158] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.493323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.493396] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da83f74d-33e1-4838-a0f1-70f509a0a68c',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.494065] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaa139e8-f09f-4a46-897a-d481019a63be taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.494205] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.494277] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.494430] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.494498] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaa139e8-f09f-4a46-897a-d481019a63be',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.000531] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.000961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.000961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.000961] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.001161] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.001342] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.001957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.001957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.001957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.001957] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.001957] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.059857] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.060114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.060114] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.060280] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.061924] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.062045] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.067584] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.067759] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.068489] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.068585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.076350] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.076504] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.077735] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.077822] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.078229] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.078329] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.079045] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.079144] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.079918] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.080016] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.080732] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.080825] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.081620] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.081715] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.083353] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1563.083782] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.083897] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.086176] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1563.086619] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.086725] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.087382] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1563.087824] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.087908] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.088629] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1563.089060] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.089185] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.089782] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1563.090203] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.090384] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.090940] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1563.091401] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.091512] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.092206] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1563.092646] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.092739] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.093374] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1563.093754] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.093849] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.094466] env[69491]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1563.094902] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.095034] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2718fb34-4e94-4380-bd09-5b025d3b2125 is going to be deleted. [ 1563.095885] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.096108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.113108] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.113250] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c5808a0-5aae-42f0-89ec-a7d1d00bc588 is going to be deleted. [ 1563.114128] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.114338] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.133089] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.133274] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d226f0cc-ed68-4bbb-a45f-f167f2ea29ab is going to be deleted. [ 1563.134156] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.134363] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.150394] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.150615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.153629] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.153756] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 491f4d82-845e-4e02-b3d7-2b5c77772eb6 is going to be deleted. [ 1563.154689] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.154911] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.165368] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.165522] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.175967] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.176104] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96abde26-4f7d-4753-9d4c-ed85ae0b31bf is going to be deleted. [ 1563.176999] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.177230] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.200256] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.200415] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f1845a9-2c44-4df3-b2c4-babd12fe1f1d is going to be deleted. [ 1563.201416] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.201655] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.203276] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.203393] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.211728] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.211884] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.249607] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.249797] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.250784] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.250880] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57178755-8937-4ec8-907c-6e349b3947d2 is going to be deleted. [ 1563.251820] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.252066] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.302291] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.302494] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.303451] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.303586] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5d9b441-54c3-4ef0-8866-aee0f17f0fb9 is going to be deleted. [ 1563.304537] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.304756] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.505643] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.505797] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c9d4b0f-923e-4454-badc-cbd5c63e211f is going to be deleted. [ 1563.506712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.506935] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.508365] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.508477] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.508675] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.539854] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.540074] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e040c3ad-864e-4a08-8074-d3b87c80b2c3 is going to be deleted. [ 1563.541062] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.541328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.563084] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.563276] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.580176] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.580337] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57114c60-305d-46b5-a583-fad2bd258d54 is going to be deleted. [ 1563.581333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.581585] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.636460] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.636666] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaa139e8-f09f-4a46-897a-d481019a63be is going to be deleted. [ 1563.637547] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.637762] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.645048] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.645232] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.652810] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.652982] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.661024] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.661209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.692396] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.692565] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86024434-1c7d-4212-8500-b6ef6ea57af9 is going to be deleted. [ 1563.693577] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.693797] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.752720] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.752885] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 556224b2-1959-4315-89ac-879f1d706247 is going to be deleted. [ 1563.753879] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.754122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.755693] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.755788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.822376] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.822600] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.842068] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.842240] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da83f74d-33e1-4838-a0f1-70f509a0a68c is going to be deleted. [ 1563.843182] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.843407] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.869288] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.869460] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d394eeb6-7de4-4a71-8d79-c137cc55ad50 is going to be deleted. [ 1563.870387] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.870597] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.903338] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.903556] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.925615] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.925776] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1174b667-c607-4471-b059-900f8b5c4de2 is going to be deleted. [ 1563.926695] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.926924] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.959621] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.959826] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.987055] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.987208] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9028d23d-9b03-48da-a060-d720486e9412 is going to be deleted. [ 1563.988153] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.988379] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.011526] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.011913] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.011913] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf9b465c-1203-4ee7-a3bb-19ccfc886da5: rpc.has_security_group_logging(os_id): False [ 1564.065427] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.065667] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.079062] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.079246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.080201] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.080335] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.092970] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.093140] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2 is going to be deleted. [ 1564.094096] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.094328] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.094421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.094545] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2718fb34-4e94-4380-bd09-5b025d3b2125" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.094704] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.094863] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.094943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.095075] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c5808a0-5aae-42f0-89ec-a7d1d00bc588" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.095610] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.095803] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.095892] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.096086] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d226f0cc-ed68-4bbb-a45f-f167f2ea29ab" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.096238] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.096397] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.096483] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.096596] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-491f4d82-845e-4e02-b3d7-2b5c77772eb6" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.096730] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.096881] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.096963] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.097088] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96abde26-4f7d-4753-9d4c-ed85ae0b31bf" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.097224] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.097374] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.097455] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.097567] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f1845a9-2c44-4df3-b2c4-babd12fe1f1d" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.097698] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.097843] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.097923] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.098049] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57178755-8937-4ec8-907c-6e349b3947d2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.098184] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.098333] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.098410] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.098524] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5d9b441-54c3-4ef0-8866-aee0f17f0fb9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.098654] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.098798] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.098872] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.098981] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c9d4b0f-923e-4454-badc-cbd5c63e211f" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.099122] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.099264] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.099339] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.099447] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e040c3ad-864e-4a08-8074-d3b87c80b2c3" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.099572] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.099708] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.099780] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.099890] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57114c60-305d-46b5-a583-fad2bd258d54" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.100024] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.100162] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.100236] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.100346] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaa139e8-f09f-4a46-897a-d481019a63be" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.100475] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.100611] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.100712] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.100785] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86024434-1c7d-4212-8500-b6ef6ea57af9" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.100910] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.101090] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.101189] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.101246] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-556224b2-1959-4315-89ac-879f1d706247" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.101371] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.101508] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.101579] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.101691] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da83f74d-33e1-4838-a0f1-70f509a0a68c" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.101813] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.101946] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.102032] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.102143] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d394eeb6-7de4-4a71-8d79-c137cc55ad50" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.102268] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.102405] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.102480] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.102587] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9028d23d-9b03-48da-a060-d720486e9412" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.102718] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.102855] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.188729] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.189091] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.189208] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.189263] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.189473] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.189555] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.189642] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be updated. [ 1564.190809] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.191023] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.191126] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.191235] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1174b667-c607-4471-b059-900f8b5c4de2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.286488] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.286688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.286688] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.286842] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.286940] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.287085] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a3d6a5c-ffbe-4c17-aabc-ee09ef2456f2" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.335019] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.335209] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.335244] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.335761] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.336123] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.362635] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: IN_PROGRESS for 2s [ 1566.383892] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1566.384320] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.472197] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1567.472577] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1572.473834] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1572.474304] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1577.475123] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1577.475529] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1582.476963] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1582.477357] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1587.478095] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1587.478505] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1592.479699] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1592.480112] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1597.481397] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1597.481771] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1602.482628] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1602.482952] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1607.484260] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1607.484615] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1612.485608] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1612.486028] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1613.021581] env[69491]: INFO networking_nsxv3.common.synchronization [req-0b9089e5-b040-45e0-8242-3fc99af156f0 req-71a204b5-61c3-4e06-b763-9f21a01548ab tempest-ServerActionsTestJSON-1508696760 tempest-ServerActionsTestJSON-1508696760-project-member] Enqueued Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1613.022183] env[69491]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 with Priority: HIGHEST for action security_group_members [ 1613.022533] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5 taken with stack trace [, , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.022666] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.022734] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.022943] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.023143] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.023292] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.023362] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.023532] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.023917] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.023917] env[69491]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf9b465c-1203-4ee7-a3bb-19ccfc886da5',) {} {{(pid=69491) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1613.525893] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.526323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.526323] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.526392] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.526421] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.526627] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.526721] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.526789] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.526920] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.526994] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.527100] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 is going to be updated. [ 1613.556558] env[69491]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.556558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.556558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.556558] env[69491]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.556826] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.573915] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: IN_PROGRESS for 2s [ 1615.585328] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 in Status: SUCCESS [ 1615.585788] env[69491]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf9b465c-1203-4ee7-a3bb-19ccfc886da5 deletion is rescheduled due to dependency. [ 1615.585788] env[69491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf9b465c-1203-4ee7-a3bb-19ccfc886da5" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1618.023759] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1618.024053] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1623.025200] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1623.025642] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1628.026941] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1628.027283] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1633.028180] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1633.028627] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1638.029464] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1638.029799] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1643.031340] env[69491]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1643.031722] env[69491]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0